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Brief Reports: 


A New Publication Procedure 


For a trial period, the Journal of Consult- 
ing Psychology will accept “brief reports” for 
early publication without expense to the au- 
thor, under certain conditions. The new pro- 
cedure is intended to reduce publication lag 
and permit the circulation of worth-while 
studies of specialized interest or minor im- 
portance which cannot be accepted at present 
because of limitations of space. 


A brief report, strictly limited to one printed 
page, may be accepted if the author agrees to 
make a more extended report available. Up to 
four pages in each issue may be devoted to 
brief reports, published in the order of their 
receipt without regard to the dates of receipt 
of articles accepted for regular publication. It 
is anticipated that most of the brief reports 
can appear in the first or second issue to go to 
press following their acceptance. 

The procedure for submitting a brief re- 
port is: 

1. The author sends the editor doth the 
brief report and a more complete report of the 
study. The full report should be of sufficient 
length to give a clear account of the back- 
ground, procedure, results, and conclusions of 
the study. 


2. The full report is prepared in the style 
specified by the Publication Manual [1], ex- 
cept that it may be typed with single spacing. 
The editor will send the full report to the 
ADI. 


3. The brief report gives a clear, condensed 
summary of the procedure of the study, and 
as full an account of the results as space per- 
mits. To insure that the brief report does not 


exceed one printed page, the author prepares 
it according to these specifications : 

The text of the brief report, including all 
matter except the title and the author’s lines, 
does not exceed 80 typewritten lines averaging 
42 characters and spaces in length. Set the 
typewriter margins for short lines of 42 char- 
acters, which are 3.5 inches long in elite typing, 
or 4.2 inches long in pica. The manuscript is 
double spaced throughout and, except for the 
short lines, follows the standard style [1]. 

Headings, tables, and references are avoided 
in the brief report. If essential, they must be 
counted in the 80 lines. The brief report in- 
cludes, within its 80 lines, a footnote in this 
style :" 

1An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. [giving the author’s full name 
and address] or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. ... from ADI Auxiliary 
Publications Project, Photoduplication Service, Li- 
brary of Congress, Washington 25, D. C., remitting 
in advance $........ for microfilm or $........ for photo- 
copies. Make checks payable to Chief, Photoduplica- 
tion Service, Library of Congress. 

4. The author of a brief report prepares at 
least 100 mimeographed copies of the extended 
report. He agrees: (a) to send copies of the 
extended report upon request as long as the 
supply lasts, and (6) not to submit the ex- 
tended report for publication to another 
printed journal of general circulation. 
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An Assessment of the Current Role of 
Psychodiagnostic Testing’ 


Alan K. Rosenwald 


University of Illinois, College of Medicine 


In any attempt to consider the current role 
of psychodiagnostic testing in clinical psychol- 
ogy, one can see analogues in the divergent 
opinions and shades of thought characteristic 
of our political scene. 

Our various media of current opinion have 
given much, perhaps too much, consideration 
to the varied political philosophies adopted by 
this or that person. Liberal, conservative, na- 
tionalist, internationalist, leftist, rightist, etc. 
have become common terms of approval or op- 
probrium. To a lesser degree, it seems that psy- 
chologists are just as likely to stereotype their 
fellow psychologists by some equally superficial 
characteristic. The clinician decries the experi- 
mentalist as lacking in certain qualities, chiefly 
human; the experimentalist condemns the cli- 
nician by use of the telling, if overly used, 
phrase, ‘““He’s no scientist.” Clinicians war with 
other clinicians so that “the battle lines are 
drawn.” Projectivists clashing with the non- 
projectivists, objectivists with the intuitionists, 
statisticians with the qualitative analysts, and 
Freudians with the non-Freudians are illus- 
trative of the strife in which each and everyone 
of us becomes involved. 


In this evaluation of the current major 
trends in diagnostic testing and in trying to 
anticipate our hopes or expectations of the fu- 
ture, the writer, too, finds himself forced into 
the use of labels. With this injected note of 
warning about possible oversimplification, the 
writer would wish to consider the trend, or 
label, illustrated by the school of thought he 
has designated as conservative. The conserva- 
tive seeks to demonstrate the validity of his di- 
agnostic instruments. In fact, the concern 
seems more than primary; it seems to be an all- 


1Presented as part of the symposium, “Assessment 
of Current Trends in Psychodiagnosis,” at the APA 
meeting, Cleveland, September, 1953. 
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encompassing one. This evaluative statement 
should not be construed as an attempt to decry 
validity and/or reliability studies, nor is it a 
passing glance at superficially recognizing the 
need for such studies only to embark on a series 
of psychological speculations which lack any 
scientific basing. It is a matter of concern, how- 
ever, that the literature abounds in numerous 
studies which by their design seem almost des- 
tined to purposefully devalue certain tests. 

As an example of the validational or so- 
called scientific approach, a study by Witten- 
born illustrates the grievous principle when he 
says, “One of the outstanding characteristics 
of the Rorschach responses is their highly indi- 
vidual quality, their extreme variability from 
person to person. This makes conventional 
statistical treatment of Rorschach data awk- 
ward because of the difficulty in securing a 
large number of roughly identical responses. 
For example, out of a group of one hundred 
normal subjects many, if not all, would report 
human movement responses but relatively few 
would have more than two, or at the most, 
three identical responses in common. In the 
present study an attempt has been made to re- 
duce this difficulty by the use of the Harrower- 
Erickson checklist” [6, p. 258]. Wittenborn 
then notes that some question has been raised 
as to the validity of this check list for diag- 
nostic purposes, but defends his use in this par- 
ticular study since he wants to investigate the 
interrelationship of various scoring factors, spe- 
cifically, movement and color. It would seem 
that such a defense is, at best, questionable, 
since if the check list is invalid for diagnostic 
purposes, then one would logically question 
whether or not the responses gained from such 
a procedure could permit one to make sound 
inferences about the Rorschach method in its 
clinical setting. Moreover, it would seem that 
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there is a potential danger to the reasoning 
which Wittenborn uses. According to his rea- 
soning, if we have a particular test which fails 
to lend itself to being treated by orthodox sta 
tistical procedures, then the test itself must be 
altered so as to render it suitable for statistical 
manipulation. The reasoning is something like 
this: a switch to an invalid check list permits 
the data to be processed statistically. In other 
words, if a particular phenomenon can't be 
measured, measure an artifact of the phe- 
nomenon. On the basis of data gained from 
measuring the artifact, one can then turn to 
generalizing about the original phenomenon. 
As illustrative of the dynamicist or the “rad- 
ical” approach, one can turn to Gurvitz’s vol- 
ume, The Dynamics of Psychological Testing 
[3]. In a particular instance, he is evaluating 
the association a patient made to a female fig- 
ure drawing. When asked for the worst part 
of the drawing, the patient replied “Toe nails; 
they’re ingrown, that’s why she’s not wearing 
Later on, in his analysis of the test pro- 
tocol, Gurvitz says, “The ingrown toe nails 
appear to represent the self-punishing and 
masochistic elements in the personality” [3, pp. 
116-119]. The existence of masochistic and self- 
punishing elements in a personality as stated 
is of no moment. Actually it would be a far 
more unusual statement in a psychological re- 
port if one could read that patients’ maso- 
chistic and self-punitive elements were of little 
import in their personality. Certainly it is diffi- 
cult to rule out the possible existence of such 
elements in personality formation; one can, 
however, question the basis on which the in- 
ference was made. Before reading his conclu- 
sion, the writer would have assumed that the 
patient was possibly attempting to be facetious 
and, by the same token, critical of the question 
or questioner. If speculation were the order, 
one might even say that the patient was trying 
to rationalize her economic deprivation, i.e., 
lack of shoes, by focusing on the somatic. At 
any rate, the elemental importance of the state- 
ment doesn’t seem so great that it permits the 
delineation of a major aspect of personality. 
Apparently many diagnosticians are doing 
what some psychoanalysts did a number of 
years ago (some still do) in attaching undue 
importance to everything that a person may 
say. Also, it would seem that we are in danger 


shoes.” 
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of covering our failure to understand certain 
personality operations by trying to couch our 
reports in high-sounding, esoteric language, 
which simply serves to make the person so de- 
scribed something less than a living being. One 
need not be unmindful of the danger that at- 
tempts to make reports too individualized may 
lead us on an unscientific road. If we get too 
enamored with our own literary creativeness 
so that we neglect to make certain general 
statements which should be made about an in- 
dividual, then an injustice is being perpetrated. 
When these general statements become “he is 
an immature individual” or “his problems of 
hostility have not been solved” or what has now 
become the most cliché of psychological clichés, 
“his intellectual efficiency does not measure up 
to his intellectual potential,” then it would ap- 
pear that our reports have become jaded, lack- 
ing in specific statements about an individual, 
and are becoming a mass of generalities which 
unfortunately don’t even glitter. 

Holt’s analysis of the TAT of Jay, a case 
study, illustrates too well the point. Before 
setting down to analyze the results, Holt gives 
his ESP interpretation. “As a kind of control, 
I decided to set down, before looking at the 
TAT some of the truisms and clichés that are 
found in most test reports, and that can be 
fairly safely said once you know someone is a 
patient of Jay’s age and sex” [5, p. 457]. Then 
follows this ESP interpretation, which makes 
perfectly good reading and is just as definitive 
as many psychological reports that thrive in 
case files throughout the country. 

Much of what has been said has concerned 
itself with the varying attitudes held toward 
projective tests. Many of the same observa- 
tions can be made if we examine the area of 
intelligence testing. The following statements 
are found in Patterson’s manual: “His social 
judgment is relatively superior, indicating that 
he has been capable of profiting by his experi- 
ence. In contrast, however, foresight and plan- 
ning ability (Picture Arrangement) is poor. 
This poor performance may have been affected 
somewhat by his difficulty of attention and con- 
centration which may also have affected the 
Picture Completion and Digit Symbol as well 
as the Digit Span tests. Picture Arrangement 
and the Similarities as well as Vocabulary may 
also be affected by cultural background. In 
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the Picture Arrangement test, after success- 
fully arranging the first group of pictures 
from left to right, he arranged the next 
group from right to left and could give no 
explanation when asked to; he immediately 
placed the next series (the elevator) in a ver- 
tical order” [4, pp. 36-37 |. Here again, we are 
confronted with interpretations that fail to ac- 
count for discordant elements in the data as 
well as end up by denying the interpretation 
which has just been given. If we have an indi- 
vidual whose social judgment is relatively su- 
perior, then it would seem that his foresight 
and planning ability should also be superior. 
If, however, the performance of a patient is 
affected by both lack of concentration and at- 
tention, as well as poor cultural background, 
then perhaps we are not permitted to infer 
what an individual’s foresight and planning 
ability are. Maybe we should say that he is so 
distractible that we could infer he could not 
plan ahead in a prudent manner. We must 
question whether we have a measure of a per- 
son’s social judgment merely because he has a 
high score on Comprehension. Patterson does 
imply in the quotation above that his social 
judgment is an index to what the patient was 
like prior to his illness and that he had been 
capable of profiting from past experiences. If 
that is the case, why mention a poor cultural 
background, which would certainly connote a 
lack of experiences, common to all of us, from 
which he could profit. Further, why is there no 
emphasis on the confusion which surrounds the 
performance on the Picture Arrangement test 
and which would warrant considering it the 
production of a brain-damaged individual. 
These examples from Patterson, Gurvitz, 
and Wittenborn have been selected at random 
from the literature to illustrate certain trends 
in diagnostic testing, rather than as three par- 
ticular studies with which the writer wishes to 
quarrel. Certain conclusions should be drawn 
from these types of studies. First, it seems that 
our need for purification of our diagnostic in- 
struments has led us all too frequently into neg- 
lecting how we get data, but then becoming 
extremely precise in our measurement of very 
unprecise primary data. Secondly, our need to 
demonstrate our “know-how” has caused us to 
engage in many speculative statements, of which 
a great number cannot be validated because we 
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have no criteria by which to demonstrate their 
validity. In other words, their world-wide ap- 
plicability to man makes our individual patient 
no different from anybody else in the world. 
Finally, we apparently seem unable to ever 
categorically and unequivocally state that we 
don’t know the answer to a particular question 
— in other words, that we just don’t have all 
the answers to all the questions. Rather we 
seem to get involved in a series of statements, 
some of which say one thing, followed by state- 
ments which deny what we have just said. Per- 
haps this is a tribute to our capacity for toler- 
ating ambiguity; it does not, however, make 
for definitive diagnostic interpretations. 

One should pause and consider some of the 
uses of diagnostic testing in a psychiatric set- 
ting. It would lead us far afield to consider 
the many different kinds of problems upon 
which we may be asked an opinion. We can say 
most referrals in a psychiatric clinic seek to 
know something about a person’s intelligence, 
both with respect to over-all capacity as well 
as strengths and weaknesses shown in the sepa- 
rate functions, something of the personality 
structure, some of the attitudinal constellations 
which are dominant in a etc. More 
broadly than this, however, is the implied ques- 
tion, “What sort of a person is this?” Pre- 
suming the person has pathology, what sort of 
expectation do we hold regarding the course of 


person, 


illness; what can we expect in therapy? The 
writer feels that most referrents are not pri- 
marily interested in how we arrive at conclu- 
sions, providing, of course, that we do not 
damage the patient in the process of reaching 
our conclusions. They are interested in our 
conclusions, either because they constitute a 
check on their subjective impressions or be- 
cause they reveal areas of personality function- 
ing which they had not been able to explore 
adequately. There is danger of belaboring the 
obvious, but it seems well to consider what we 
are doing before we try to say what we should 
be doing. If we boil down the major functions 
of diagnostic testing as aiding in differential 
diagnosis, saying something about prognosis in 
or without therapy, and always recognizing 
that diagnostic instruments are useful research 
tools, why the need to assess the role of test- 
ing? The need to establish its role grows from 
a need to define its value. This concern is en- 
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hanced by the declining emphasis on diagnostic 
testing. In recent years clinical psychologists 
have shifted overwhelmingly in the direction of 
becoming therapists — and diagnostic testing 
has become confined by the “expert” telling 
the “nonexpert” how to examine and how to 
interpret results, what to do, what not to do, 
etc. Rarely does he do what he teaches. More- 
over, the “average” person who comes for 
training in clinical psychology usually has in 
mind training in therapy or doing research, 
and only secondarily training in the diagnostic 
study of patients. The reasons which under- 
lie the subordination of diagnostic testing to 
therapy and research are too numerous and in- 
volved to consider here. At any rate, the re- 
sult is evident. Diagnostic testing may be lik- 
ened to the status of a second-class citizen who 
is tolerated and endured but who is pegged be- 
low his superiors. 

The writer questions strongly the desirabil- 
ity of this rejection of diagnostic testing for 
therapy. In turning to therapy, clinical psy- 
chologists are neglecting areas of study which 
could occupy their interest but which do not. 
This feeling does not stem from any antihu- 
manitarian or antitherapeutic origin. Certainly 
psychological research in the therapeutic proc- 
ess will lead to some very valuable contribu- 
tions. The criticism, however, is that there are 
problems in clinical diagnosis which require 
careful study, and that these will be neglected 
as the clinical psychologist focuses on being the 
practitioner. 

Thus, all of us speak very seriously of the 
need to study the normal personality, yet our 
words are, for the most part, empty ones. Ask 
yourself how long it has been, if ever, since 
you wrote a report in which adequacy of func- 
tion was the keynote of your report rather than 
a person’s many inadequacies. We are now 
very proud of our newly acquired dynamic 
orientation which permits us to look askance at 
the work of Kraepelin, Bleuler, or any of the 
more descriptive psychiatrists. Instead, we 
speak knowingly of weak ego functioning, poor 
reality testing, latent schizophrenia, etc. until 
we are caught up in a series of ritualistic state- 
ments which, although colorful, fail to help us 
understand the patient. 

We are victims of what Herbert Block, the 
Washington Post cartoonist, in his The Her- 
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block Book calls Mumbo-jumbo. “One of the 
things that makes life complicated . . . is the 
practice of Mumbo-jumbo. Mumbo-jumbo, as 
I use the term, is the transference of devotion 
from a set of principles to the symbols and ritu- 
als that are built around them. It’s the busi- 
ness of taking over a good sound idea, building 
an elaborate shell around it, then carefully re- 
moving the already wilting idea and beating 
its brains out with the shell. Mumbo-jumbo 
creeps up in practically every field of endeavor. 
It gets into the arts . . . into medicine when 
the operation becomes more important than the 
patients” [2, pp. 41-42]. 

Granted that we lose the patient in the 
process of studying him, why should this be? 
Partially, it is because we have failed to see 
the patient as he lives from day to day. In our 
assessment of people, we are seemingly at a loss 
in predicting such elementary things as how 
the person gets along with other persons, 
whether a patient is liked or disliked by other 
patients, what sorts of people he likes or dis- 
likes, who the leader of a psychiatric ward 
might be, how the patient would get along 
with certain authority figures, etc., etc. It is 
not unreasonable to propose that validational 
studies should concern themselves with such 
problems. ‘The writer concludes, a priori, that 
there is nothing wrong with psychologists 
spending time observing the behavior of people. 
As an example, one can see much merit in the 
approach of Barker and co-workers [1]. The 
time-worn story about a patient’s remark to a 
psychiatrist still holds. “What do you know 
about a patient? You only see him once, the 
nurses and attendants are here only eight hours 
a day, but me, I’m here a full 24 hours a day. 
What do you want to know about so and so?” 

Increased knowledge of the ins and outs of 
a patient’s life should lead us to try and cast 
our studies in a more practical mold. Not only 
that, but it might lead us to use our diagnostic 
instruments as a means of assessing the person 
as he lives from day to day rather than describ- 
ing him by means of a series of generalized 
statements which are impressive and high- 
sounding, but not very meaningful. 

In closing, the writer would like to re-em- 
phasize his feeling that diagnostic testing 
should further our understanding of personal- 
ity structure and add to our limited knowledge 
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of psychopathology. If we glance back at what 
has been written, much has been couched nega- 
tively. This negativism, as it were, has its justi- 
fication in a feeling that we are not pressing 
toward the solution of major problems in clini- 
cal psychology which could be aided by diag- 
nostic testing. Our literature is swollen with 
papers reporting the administration of good 
clinical programs, validation or invalidation of 
countless tests, and innumerable brochures and 
manuals on interpretation of this or that test. 
We seem to be avoiding any long-term prob- 
lems in clinical psychology; administrative 
planning and the mushrooming development of 
new tests with all the standardization prob- 
lems lend our work a certain frenetic quality. 
Is it an idle hope that we will move in the 
direction of long-term studies which seek to 


answer certain basic problems. 


Received February 22, 1954. 
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Acceptance and Acceptability: An Examination of 
Social Reciprocity ” ° 
Seymour L. Zelen 


State University of lowa 


One hundred and forty-five sixth-grade chil- 
dren in five classes were given the Bonney So- 
ciometric, the Feelings of Personal Worth 
Subscale of the California Test of Personality, 
and the W-A-Y technique. The latter two in- 
struments yielded scores of self-acceptance, 
while the sociometric gave scores of peer status 
and acceptance of peers. 

Peer acceptance correlated .59 with accept- 
ance of others, significant at the .01 level, and 
.30 and .39 with the self-acceptance scores of 
the W-A-Y and the CTP Feelings of Person- 
al Worth Scale respectively, both significant 
at the .01 level. Acceptance of others corre- 
lated .08 with the W-A-Y and .10 with the 
Personal Worth Scale; neither of these proved 
significant. 


The expected positive correlations of peer 
acceptance with acceptance of others and ac- 
ceptance of self were obtained. This suggests 
that liking others and being liked by others are 
reciprocal characteristics. Individuals with high 
group status tend to find many group members 


‘An extended report of this study may be ob- 
tained without charge from Seymour L. Zelen, Child 
Welfare Research Station, University of Iowa, Iowa 
City, Iowa, or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. 4307 from ADI Auxil- 
iary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 

2This research was supported by Research Grant 
MH-301 from the National Institute of Mental 
Health, of the National Institutes of Health, U. S. 
Public Health Service. 


highly acceptable. Self-perception and percep- 
tion by one’s peers also produced a significant 
relationship. These findings suggest that a child 
who has positive feelings about himself is bet- 
ter able to devote his energies to the group ac- 
tivities and to cooperate more fully with others. 
The child with negative self-percepts may be 
constantly on guard against new perceived 
threats from others. 


The lack of any relationship between the 
measures of self-acceptance and acceptance of 
others was unexpected. An interpretation is 
offered in terms of the discriminability of in- 
terpersonal or social cues. 


It is possible that children might be aware 
of and capable of discriminating cues of ex- 
ternal behavior, but would not be aware of the 
cues upon which the more subtle social rela- 
tionships are based. 


Brief Report 
Received June 24, 1954. 
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Rorschach Color Responses and Manifest Anxiety 
in College Women 


Wayne H. Holtzman, Ira Iscoe 
The University of Texas 


and A. D. Calvin’ 


Michigan State College 


In recent years there has been a sharp in- 
crease in the number of experimental studies 
concerning the validity of the Rorschach test. 
In particular, a group of investigations has ap- 
peared dealing with the nature of reactions to 
color. In reviewing these studies, Benton [2] 
and Hertz [9] point out the generally negative 
findings with respect to the effects of color and 
emphasize the need for considerable revision of 
earlier Rorschach theory. Most of these studies 
are limited in that they dealt with the valida- 
tion of only one or two Rorschach scores or con- 
sidered only one of many pertinent independent 
variables. 

The present research was designed to in- 
vestigate the effects of anxiety, color, stimulus 
configuration, order of presentation, and ex- 
aminer, considered singly and in combination, 
upon a large number of Rorschach variables. 


Description of the Study 


The Minnesota Multiphasic Personality 
Inventory (MMPI) was administered to 696 
college women in various dormitories and so- 
rorities at The University of Texas. Answer 
sheets were scored for both the Taylor Mani- 
fest Anxiety Scale [17] and the Winne Scale 
of Neuroticism [20]. High- and low-anxiety 
groups were established by selecting women 
having both Taylor scores in the upper or low- 
er 15 per cent and Winne scores in the upper 
or lower 25 per cent of the respective distribu- 
tions. Greater emphasis was placed upon Tay- 
lor’s scale than Winne’s because of its higher re- 
liability and its more extensive use in previous 
experimental studies of anxiety [10]. One hun- 
dred and twenty-eight women, 64 from each cri- 


1Formerly at The University of Texas. 
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terion group, served as subjects in the experi- 
ment. 


Achromatic copies of Rorschach Cards II, 
III, VIII, and 1X were carefully prepared by a 
special photographic process to insure faithful 
reproduction of the inkblots. ‘These particular 
cards were chosen for the following reasons. 
First, Cards I] and III represent one kind of 
color application while cards VIII and IX rep- 
resent another. The former have but a single 
color, bright red, while the latter have a varie- 
ty of colors blending together. It is quite possi- 
ble that one type of color would have a difter- 
ent effect than the other. Second, Cards II and 
III are only partly colored and partly black 
and white, whereas Cards VIII and IX are 
completely colored. The advantages of using 
these two pairs of cards rather than any others 
will become apparent when the experimental 
design has been discussed. 

Since it was desirable to study simultane- 
ously a number of independent variables in 
order to isolate interactions as well as main ef- 
fects, a rather elaborate experimental design 
was employed. Thirty-two basic plans were 
constructed in which stimulus configuration or 
inkblot, color, and order of presentation were 
varied systematically in a completely balanced 
fashion. One half of the subjects received a 
colored card on the first trial, the other half 
getting an achromatic card first. Similarly, each 
stimulus configuration appeared equally often 
on each trial. A standard procedure with full 
inquiry, according to Klopfer and Kelley [11], 
was used ; each individual was administered all 
four inkblots, two in the original Rorschach 
version and two in the achromatic form. 


The number of possible permutations or 
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orders of presentation of the four inkblots, ig- 
noring the presence or absence of color, is 24. 
This was reduced to eight by pairing Card II 
with Card III] and Card VIII with Card LX. 
Thus, both members of a given pair always ap- 
peared together in either the first or last two 
trials. When the color variabie (chromatic vs. 
achromatic) was superimposed on stimulus 
configuration, a total of 32 plans was required 
to balance the design completely. 


With 128 subjects, four replications of the 
basic design were possible. Two additional in- 
dependent variables, Examiner X vs. Examiner 
Y, and high-anxiety group vs. low-anxiety 
group, used up the replications. Since much of 
the confusion in the Rorschach literature may 
be a function of examiner variance, two ex- 
aminers were used, one with considerable ex- 
perience in administering and interpreting the 
Rorschach and the other with formal training 
on the Rorschach but little clinical experience. 
Subjects within each anxiety group were assign- 
ed at random to examiner and plan by a third 
person, the only individual who knew whether a 
particular subject belonged to the high- or low- 
anxiety group. This was necessary to avoid the 
possibility that the examiner’s administration of 
the cards might be influenced by knowledge of 
the subject’s classification. 


Every Rorschach response was scored for 
location, form level, movement, shading, and 
content. Because of the subjectivity necessarily 
involved in scoring form level, each response 
was scored twice according to Beck’s tables for 
F + % [1] by two psychologists working inde- 
pendently. The interscorer reliability for F 
+ Y% was .83. The actual scoring reliability 
was probably higher since every scoring dis- 
crepancy was resolved by a conference of all 
three authors. The number of responses, the re- 
action time, and any overt remarks by the sub- 
ject were also recorded for each card. In addi- 
tion, every protocol was scored according to 
Elizur’s signs of anxiety [8], a list of signs 
based on content analysis. 


Results 


Since all possible advance clues to the sub- 
ject’s classification were withheld from the ex- 
aminers, the more experienced of the two ex- 
aminers (X) judged each of his 64 subjects as 
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“anxious” or “nonanxious”’ solely on the basis 
of behavior during the individual testing ses- 
sion. No judgments were made by the other ex- 
aminer since he did not feel sufficiently compe- 
tent to attempt this task. A number of signs 
were employed by X in making a judgment: the 
degree of composure shown by the subject upon 
entering the room, questions regarding the pur- 
pose of the test, the subject’s attitude toward X, 
his readiness to cooperate, and his atten- 
tiveness to directions. After administering 
the test, if X still felt that he needed more in- 
formation before making a final judgment, he 
conducted a short interview in which attitudes 
toward the university, school grades, social 
activities, and plans after graduation were dis- 
cussed. The basis of judgment could best be 
described as intuitive and global, consisting pri- 
marily of behavioral signs other than specific 
responses to the test materials. A comparison of 
the judgments made by X with the actual cri- 
terion grouping is presented in Table 1. That 
he was able to detect the high- and low-anxiety 
groups with such a high degree of accuracy at- 
tests to the validity of the anxiety criterion. 


Table 1 


Success of Examiner X in Judging Anxiety Solely 
on the Basis of Subject’s Behavior during the 
Testing Period 














Examiner’s Grouping based on Taylor’s scale 

judgment High anxiety Low anxiety Total 
High 26 9 35 
Low 6 23 29 
Total 32 32 64 





x2 = 16.14 (p < .001). 


Three general levels of analysis were 
made: one based upon response to the first card 
only in the series of four cards presented to 
each subject; one dealing with only the first 
two cards in the series ; and one concerned with 
data such as total number of responses and 
F + 9% arising from «ll four cards. 


When only the first card is considered, 
four of the primary variables—examiner, anxie- 
ty, color, and Card II vs. Card I1I—can be ar- 
ranged in a 2* factorial design with four repli- 
cations to provide an adequate error term. A 
similar design exists for Cards VIII and LX. 
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Ignoring the differences cited earlier between 
these two pairs of cards would allow combina- 
tion of both designs with double the number of 
cases for evaluating the effects of examiner, 
anxiety, color and their interactions. 


The dependent variables or test scores that 
were analyzed according to this design consist- 
ed of the following: (a) reaction time, the time 
from initial exposure of the card until the first 
response; (4) number of responses; (c) num- 
ber of responses using the whole inkblot; (d@) 
F + %; (e) form level of the first response 
only; (f) number of responses having some 
kind of movement as a determinant; and (¢) 
number of responses with shading as a deter- 
minant. 


Two general kinds of statistical procedure 
were used throughout the study. When the 
test scores were fairly continuous and normal 
(or could be readily transformed into a normal 
distribution), analysis of variance methods 
were employed. At the first level of analysis 
this proved to be the case only for reaction 
time. When the test scores were categorical in 
nature or relatively discrete and severely skew- 
ed, the distributions were dichotomized near 
the median and handled by chi square or 
Fisher’s exact method [6] for testing the sig- 
nificance of the difference between two percent- 
ages. 


The second level of analysis dealt with the 
first two trials together rather than Trial 1 a- 
lone. The use of a two-by-two latin square 
combined with a factorial design made possible 
an analysis of the effect of order of presenta- 
tion of the color (colored-before-achromatic vs. 
achromatic-before-colored) as well as practice 
effects, anxiety, color, and the interactions of 
anxiety with color, trial, and order. This was 
done separately for Cards II and III and for 
Cards VIII and IX. Differences among the 
stimulus configurations were completely lost 
owing to confounding. This design was em- 
ployed for the analysis of reaction time only 


since the other variables were too discrete and 
skewed. 


The third level of analysis was concerned 
with data obtained from the subject’s perfor- 
mance on all four cards. In this case only anx- 
iety and examiner could be studied as indepen- 
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dent variables, using a two-by-two factorial de- 
sign. The test data comprising dependent vari- 
ables consisted of the following: (a) mean re- 
action time to all four cards; (4) 
between mean time to the colored 
cards and that to the achromatic ones ; (c) total 
number of responses; (d) total F + %; (e) 
number of cards on which the first response had 
a poor form (f) difference between 
F + % for the colored cards and F + % for 


difference 
reaction 


level ; 


the achromatic ones; (g) number of whole re- 
sponses; (hk) movement; (i) shading; (7) Sum 
C scores; (&) Elizur’s anxiety score; (/) an- 
imal content (4 Ad); (m) human content 
(H + Had); (mn) rejected cards; and (0) 
spontaneous, immediate remarks concerning the 
color. The first four of these scores were han- 
dled by analysis of variance while the remainder 
were analyzed using chi square and related pro- 
cedures. 


Reaction time. Much has been said in Ror- 
schach literature concerning the psychological 
meaning of reaction time. A significant increase 
in reaction time to colored cards is generally 
considered an indication of “color shock’’ [11, 
14]. Emotionally disturbed individuals will 
presumably have a long reaction time or show 
other disturbances due to colors, especially on 
Cards II and III. From this we might expect 
that, in general, mean reaction times for the 
colored cards would be longer than those for 
the achromatic versions. Moreover, there should 
be a significant interaction between color and 
anxiety with respect to reaction time if the 
above theory is correct. 


A more comprehensive analysis was made of 
reaction time than of any other variable, mainly 
because of the continuous nature of reaction 
time scores, which permits the use of analysis of 
variance. Since the original scores were skewed 
in the typical fashion of reaction time data, an 
inverse square root transformation was em- 
ployed to normalize the score distributions prior 
to analysis. An analysis of variance of the trans- 
formed reaction time scores for Trial 1 only 
and for Rorschach Cards II and III is pre- 
sented in Table 2. 


In this analysis, all insignificant, higher order 
interactions were pooled with the within sum 
of squares to provide an error term with 57 
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Table 2 


Analysis of Variance of Transformed Reaction 
Time Scores for Rorschach Cards II and III, 
First Trial Only 











Source of Mean 

variation square df F »p 
Examiner 220.9 1 163 — 
Anxiety 11.4 1 0s — 
Inkblot 8 1 01 — 
Color 876.2 1 6.50 .02 
Examiner by color 581.1 1 4.31 .05 
Examiner by anxiety by 1095.5 1 8.13 .01 

inkblot 

Pooled residual 134.8 57 





df. Only one of the main effects was significant. 
Reaction time to the colored cards was signifi- 
cantly faster than response to the achromatic 
cards. Although this was more the case for Ex- 
aminer Y than for Examiner X, as evidenced by 
the significant examiner-color interaction, these 
results suggest, contrary to the opinion of many 
clinicians, that bright red color, as applied on 
Cards Ii and III, evokes an earlier response 
than if these cards were achromatic. 


‘Lhe critical source of variance from the 
point of view of Rorschach theory, the inter- 
action between anxiety and color, was negli- 
gible. Both “anxious” and “nonanxious’” wo- 
men responded in an identical manner. The 
hypothesis that differences in reaction time to 
colored and achromatic inkblots are related to 
anxiety has not been substantiated by analysis 
of response to the first card only. 


The interpretation of the significant triple 
interaction, examiner-anxiety-card, is unclear. 
Assuming that this is a nonchance result, it 
probably reflects examiner differences more than 
anything else and would prove theoretically 
important only if one or more of the lower 
order effects involving these three variables had 
also been significant. 


The same analysis of Cards VIII and LX re- 
vealed no significant factors related to reaction 
time. Unlike Cards II and III, reaction time 
to these cards is the same in both the multicolor- 
ed, standard form and in the achromatic exper- 
imental version. These results are consistent 
with the findings of Dubrovner et al. [5], who 
found no differences in reactivity that could be 


attributed to color. The present study suggests, 
however, that the bright red color may stimu- 
late the subject to respond more quickly. 

On the other hand, Siipola [16] reported 
just the opposite for a number of colored areas 
of the Rorschach inkblots. Using matched color- 
ed and achromatic versions of smaller inkblots 
obtained by cutting out the usual detail areas 
of Cards II, III, VIII, LX, and X, she found 
consistently longer mean reaction times for 
college women when color was present than 
when it was absent. Additional experimenta- 
tion, with color and inkblot varied systematic- 
ally in an extensive factorial design, is necessary 
to resolve these apparent contradictions. 


Table 3 contains the results for reaction time 
on Cards II and III when the first two cards 
presented to the subject are considered simul- 
taneously. Only one source of variation, the or- 
der of presentation of color, proved significant. 
The colored-before-achromatic order yielded 
a significantly faster reaction time than 
the reverse order of presentation. Again it ap- 
pears that the bright red colors are stimulating 
to the subject, this time shortening the latency 
of his response to the card which follows. 

At the third level of analysis, employing all 
four cards, two scores were derived from the 
reaction time data: (a) mean reaction time; 
and (4) difference between mean reaction time 
to the colored cards and mean reaction time to 
the achromatic cards. The latter was of par- 
ticular interest since previous writers [2, 11] 
on color shock have stated that a delay in reac- 


Table 3 


Analysis of Variance of Transformed Reaction Time 
Scores for Rorschach Cards II and III, 
First Two Trials 








Source of Mean 











variation square df F p 
Independent observations 
Anxiety 0 1 0.00 
Order of color 2080 1 7.07 .01 
Order by anxiety 488 1 1.66 
Residual between subjects 294 60 
Correlated observations 
Trial 7 1 0.10 
Color 66 1 0.96 
Trial by anxiety 6 1 0.09 
Color by anxiety 149 1 2.16 
Residual within subjects 69 60 








Rorschach Color Responses and Manifest Anxiety 321 


tion time to a colored card is one sign of 
“shock” that presumably occurs with greater 
frequency in neurotic or anxious individuals 
than in others. An analysis of variance was 
made for each variable, breaking down the total 
variance into components attributable to ex- 
aminer, anxiety, and examiner-anxiety interac- 
tion, each having 1 df, and an error term with 
127 df. In neither case did either of the main 
effects or their interaction approach signifi- 
cance. 


The results of these three different sets of 
findings concerning the extent to which reaction 
time is a function of examiner, anxiety, inkblot, 
color, and their interactions can be summar- 
ized as follows. Contrary to the opinion of 
many psychologists, there is little evidence to 
support the use of a long reaction time to a chro- 
matic inkblot as a sign of color shock. Likewise, 
there is little support for the contention that 
anxious individuals take longer to respond to 
colored than to black and white inkblots, 
whereas nonanxious subjects do not. If any- 
thing, the bright red color on Cards II and III 
apparently stimulates most individuals to re- 
spond more quickly. This stimulation may 
carry over to the next card, as illustrated by a 
quicker response to the second card when the 
first inkblot was partly covered by bright red 
color. Throughout the analysis of reaction time 
a consistent difference was found between 
Cards II and III on the one hand and Cards 
VIII and IX on the other. This finding raises 
some interesting questions for further research 
concerning the comparative effects upon reac- 
tion time of variation in hue, configuration, and 
mode of applying the color to the inkblot. 


Number of responses. Although the number 
of responses given to the first card ranged from 
one to fifteen, most women gave only one or 
two responses per card. Because of the discrete- 
ness and skewness of the data when only the 
first card was considered, it was necessary to 
resort to less efficient methods than analysis 
of variance to determine the role played by each 
independent variable. The distribution of scores 
was dichotomized close to the median, and four- 
fold tables were constructed ; one independent 
variable was considered at a time and the others 
ignored. This was done separatcly for Cards II 


and III and for Cards VIII and IX as well as 


for all four inkblots combined. The only vari- 
able which showed a significant relationship to 
number of responses on the first card was color 
for Cards II and III. Inspection of ‘Table 4 re- 
veals that significantly more women gave more 
than one response to the colored cards than to 
the achromatic ones. Apparently the bright red 
colors on Cards II and III stimulate the indivi- 
dual to greater productivity and also to respond 
more quickly than otherwise. 


Table 4 


Number of Responses to the First Card as a 
Function of Color, Rorschach Cards II and III 


Number of Color of inkblot 


responses Chromatic Achromatic Total 


2 or more 22 13 35 


1 or less 10 19 29 
Total 32 32 64 


ye c= 6.66 (6 = 85). 





When the total number of responses for all 
four cards was considered, the frequency dis- 
tribution was only moderately skewed. An an- 
alysis of variance using a two-by-two factorial 
design revealed no differences among examiners 
or high- and low-anxiety groups. 


These negative results are contrary to those 
obtained by Eichler [7] and by Westrope [18]. 
Eichler reported a significant decrease in the 
number of responses given by individuals under 
stress conditions. However, in a study relating 
Rorschach variables to Taylor’s anxiety scale, 
Westrope found just the opposite. Significantly 
more responses were given by her high-anxiety 
group than by the low-anxiety group. 


The interaction between examiner and anx- 
iety was also negligible. Since the distribution 
of scores was moderately skewed, an additional 
test was made by dichotomizing the distribu- 
tion at the median (nine responses) and con- 
structing fourfold tables for each independent 
variable. Again, no differences between groups 
were revealed. The results obtained in this ex- 
periment suggest that there is little relationship 
between the number of responses and manifest 
anxiety as measured by the MMPI. Although 
previous experimenters [4, 5, 13, 15] have con- 
cluded that color does not increase productivity, 
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the present findings indicate that the bright red 
hue on Cards II and III may result in a great- 
er number of responses. 

Form level. Each response was scored either 
“plus” or “minus,” using Beck’s tables [1] as a 
guide. When only responses to the first card 
were considered, it was discovered that no wo- 
men gave minus responses to Card III, only 2 
gave one or more minus responses to Card VIII, 
4 to Card II, and 16 to Card LX. Since a bal- 
anced design had been used by which each card 
would be presented first to 32 different women, 
it is quite clear that Card IX is more likely to 
yield a minus response than any of the other 
inkblots used in this study. This is compatible 
with the often reported fact that Card 1X has 
the longest reaction time and is the most fre- 
quently rejected card. 


Using presence of one or more minus respon- 
ses to the first card vs. no minus responses as 
one variable and one of the independent vari- 
ables (examiner, anxiety, inkblot, color) as the 
other, fourfold tables were constructed and 
tested for significance. With the exception of 
the differences already noted from one inkblot 
to the next, none of the relationships even ap- 
proached statistical significance. Similar results 
were obtained when F + % for the first card 
was analyzed. 

Consideration of total F + % based upon 
all four cards yielded different results. A sum- 
mary of the analysis of variance for the two- 
by-two factorial design is presented in Table 
5. There was no appreciable difference in the 
mean F + % for the high- and low-anxiety 
groups. This is consistent with the negative re- 
sults reported by Westrope (18), who also 
used criterion groups based on the Taylor anxi- 
ety scale, for F + % on the colored cards 
alone as well as for all ten cards. However, 
the subjects tested by Examiner Y gave a sig- 
nificantly greater percentage of responses with 
poor form level than those tested by Examiner 
X. Such results, though indicating the im- 
portance of examiner differences, are of little 
theoretical consequence since the examiner-anx- 
iety interaction is negligible. 

Two other variables dealing with form lev- 
el were studied, the number of cards on which 
the first response had poor form level and the 
difference between F + % on the colored and 
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Table 5 
Analysis of Variance for Total F + % 
Source of Mean 
variation square df F p 
Examiner 1378 1 5.58 .02 
Anxiety 43 1 0.18 — 
Examiner by anxiety R 1 003 — 


Residual 247 124 


achromatic cards. The latter was of particular 
interest because of the investigation by Wil- 
liams [19] suggesting that drop in form level 
on colored cards is a sign of poor control and 
may also be related to anxiety. Neither variable 
proved related to either examiner or anxiety in 
the present study. Fifty-five per cent of the 
women in both the high- and low-anxiety 
groups gave all four first responses with good 
form level. Both groups also showed the same 
form level on the colored cards as they did on 
the achromatic versions. Contrary to the find- 
ings of Lazarus [12], there is no evidence to 
support the hypothesis that a drop in form 
level generally occurs in moving from a black 
and white inkblot to a colored one. 

Other Rorschach variables. None of the re- 
maining variables was sufficiently continuous in 
nature to permit the use of analysis of vari- 
ance. Consequently, it was necessary to resort 
to categorical treatment, using for the most 
part fourfold tables to investigate the signifi- 
cance of the major factors under consideration. 

The number of responses using the whole 


inkblot, the number employing movement as a 
determinant, and the number using shading 
were analyzed for the first card only as well 
as for the summary data based on all four 
cards. In addition, Sum C, Elizur’s anxiety 
score, animal and human content, rejected 
cards, and occurrence of spontaneous, immedi- 
ate remarks to the color were carefully investi- 
gated for any differences between examiners 
or between the high- and low-anxiety groups. 
Aside from minor differences between exam- 
iners in the number of movement responses, no 
significant factors were discovered for any of 
the remaining variables. 

The negative results for Elizur’s anxiety 
score are of special interest because of its re- 
ported validity as a measure of anxiety [8, 18]. 
The mean score for the high-anxiety group 
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was 1.26, while that for the low-anxiety group 
was 1.15, a negligible difference. 


One explanation for the lack of significant 
results for Elizur’s anxiety score, as well as for 
some of the other Rorschach variables, is that 
the use of only four cards, instead of the 
standard set of ten cards, results in scores of 
lower reliability. Reducing the number of cards 
administered to each subject may have lowered 
the reliability of Rorschach scores in the pres- 
ent study. On the other hand, the number of 
subjects employed is sufficiently large that a 
rather small relationship should prove statisti- 
cally reliable. Although lack of such a relation- 
ship in a single experiment does not prove its 
nonexistence, it does raise serious questions con- 
cerning the uncritical adoption of the Ror- 
schach score in question for use in the clinic. 


Summary and Conclusions 


This experiment was designed to investigate 
the relationships of anxiety, color, stimulus 
configuration, order of presentation, and ex- 
aminer with a number of different Rorschach 
variables. High- and low-anxiety groups con- 
taining 64 subjects each were selected from 696 
college women on the basis of MMPI scores for 
‘Taylor’s Manifest Anxiety Scale and Winne’s 
Scale of Neuroticism. Achromatic copies 
Rorschach Cards II, III, VIII, and 1X were 
carefully prepared and used together with cor- 
responding standard cards. Four inkblots, two 
colored and two achromatic in a predetermined 
order and balanced design, were administered 
in a standard fashion to each subject by one of 
two examiners. ‘The more experienced of the 
two examiners judged each subject as “anx- 
ious” or “nonanxious” at better than the .001 
level of significance, solely on the basis of be- 
havior during the individual testing session; 
this provided a check on the adequacy of the 
criterion. 


The results and conclusions were as follows: 

1. The colored versions of Cards II and III 
yielded significantly shorter reaction times and 
significantly more responses than did the achro- 
matic versions of these same inkblots. How- 
ever, no differences ascribable to color were ob- 
tained for these same variables on Cards VIII 
and 1X. This finding suggests that the bright 
red color of Cards II and III is more stimu- 
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lating than the multicolored pastel shades of 
Cards VIII and IX. The shorter reaction 
times to the colored versions of Cards II and 
III are contrary to expectations from color 
shock theory. 


2. The colored-before-achromatic order of 
presentation resulted in a significantly shorter 
mean reaction time for Cards II and III than 
did the reverse order, achromatic before col- 
ored. This is consistent with the hypothesis that 
the bright red colors of Cards II and III 
stimulate the 
quickly. 

3. Women tested by Examiner Y gave a 
significantly greater percentage of responses 
with poor form level than did women tested 
by Examiner X, indicating the importance of 
controlling the examiner as 
search of this type. 


individual to respond more 


a variable in re- 


4. Contrary to the expectations of earlier 
Rorschach theory, none of the remaining Ror- 
schach variables proved significantly related to 
anxiety, color, or order of presentation. 

It is clear from the present research that 
many conceptions of how color, examiner, per- 
sonality, and order-of-presentation variables af- 
fect performance on the Rorschach test will 
have to be revised considerably. Further studies 
imilar to this one, which compare several fac- 
tors simultaneously by use of modern experi- 
mental design, are needed to resolve apparent 
contradictions in the literature. 


Received January 8, 1954. 
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One of the most unusual and theoretically 
interesting features of Rorschach’s inkblot test 
is the human movement determinant (1/7). In 
linking the individual’s perception of humans 
in action on the blots to stable motility, on the 
one hand, and imaginativeness or inner living, 
on the other, Rorschach [11] was in essence 
providing a concrete formulation of a theory of 
vicarious functioning similar to that presented 
by a number of writers in diverse fields of 
psychology and psychoanalysis [4, 6, 9, 18]. A 
series of investigations has provided data sup- 
porting Rorschach’s linkage of motor inhibition 
and M responses [7, 14, 15, 19]. There is al- 
so evidence that / responses are associated 
with measures of 
» 


“~, O, 


fantasy or imaginative ten- 
12, 13, 16]. Two earlier 
studies in this series have reported positive cor- 
relations between the number of M? and the 
ability of Ss to delay their speed of writing. A 
negative correlation between M and the de- 
gree of spontaneous motor activity manifested 
during a waiting period also emerged [7, 15]. 

The objectives of the present investigation 
included a partial replication of earlier findings 
[15] with another sample and an extension of 


dencies [1, 


1 Reviewed in the Veterans Administration and 
published with the approval of the Chief Medical 
Director. The statements and conclusions do not ne- 
cessarily reflect the policy or opinion of the Veterans 
Administration. The authors are indebted to Drs. 
Harold Wilensky and Jacob Cohen for helpful criti- 
cism, and to staff and psychological trainees at this 
station for assistance in various phases of the study. 


2 The focus in this study was on human move- 
ment alone. Previous studies have yielded equivocal 
results concerning the relationship of animal move- 
ment (FM) and inanimate movement (m) to M. 
This empirical distinction between the types of 
movement responses merits considerable research ex- 
ploration, 


3 


5 


the behavioral situations to include measures 
of fantasy as well as motor activity. Ihe spe- 


cific hypotheses are: 


1. Schizophrenic Ss assigned to a High-M 
group on the basis of their Rorschach records 
differ significantly from Low-M Ss on a series 
of tasks measuring motor activity and fantasy 
behavior or introspectiveness. High-/ Ss show 
greater delaying capacity, less impulsivity, less 
spontaneous motor response, and higher scores 
on measures of fantasy. A subhypothesis in this 
connection was derived from an earlier study 
*~ToK 


[15] in which it was found that wait m 


activity scores varied not only with 1” 1 
the relationship of M and the weigir 
responses (Sum C). This finding offe 

ing support to Rorschach’s juxtape 

these two types of response determinan.- 

Sum C) as an index of relative weight 
troversive or extratensive response tendencies. 
It was hypothesized, therefore, that, at least 
in the case of spontaneous motor activity ( wait- 
ing-room behavior), the degree of activity 
varies with the increasing weight of color in 
the experience balance of the patients. 


2. If Rorschach descriptions of the interre- 
lations of motor and fantasy activity are cor- 
rect, one may anticipate a certain consistency 
in Ss’ performance from one situation to the 
next. Individuals with relatively numerous MM 
also manifest greater motor inhibition, less 
spontaneous motor activity, and more fantasy. 
Specifically, the subtests that tap various as- 
pects of the motor inhibition — motion percep- 
tion—fantasy dimension are intercorrelated and 
define a common factor or meet some appropri- 
ate standard of interrelatedness. ‘These corre- 
lations may not be high because of the numer- 
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ous situational, uncontrolled factors that un- 
doubtedly limit the reliability of a Rorschach 
examination. Some gross consistency of per- 
formance is certainly to be expected, however, 
if Rorschach’s formulation has any validity. 
When Rorschach factors are used in relative 
isolation in this investigation with little con- 
cern for “configurational” features, any signifi- 
cant correlations between M and behavioral 
situations should be all the more striking as 
evidence of the essential meaning of the human 
movement determinant. 


Subjects 

In order to repeat some of the conditions of 
the previous study [15], a new sample of 60 
male schizophrenic veterans was employed. 
The Ss received clinically administered Ror- 
schachs which were rescored in consultation by 
experienced examiners. After administration of 
the five experimental procedures, the total 
sample was divided into High- and Low-M sub- 
groups. The criteria derived from examination 
of Rorschach score distributions for the sample 
were more than one M (high M) and a Sum 
C of 2.5 or more (high Sum C). The High- 
and Low-M groups did not differ significantly 
in IQ (Wechsler-Bellevue Scale), age, educa- 
tional level, or other Rorschach variables ex- 
cept M. Although differences in total responses 
(R) between the two main groups were larger 
than in the previous study, most of this dif- 
ference could be attributed to differences in 
M and FM, the mean M of the High-M Ss 
being roughly eight times as great as that of 
the Low-M group. Somewhat in keeping with 
a finding reported by Wittenborn [20], the 
pattern of color responses was somewhat dif- 
ferent for the two groups, although not signifi- 
cantly so. Thus FC responses tended to cor- 
relate somewhat better with M and R than 
with the other color determinants. 


On the whole the characteristics of this 
sample did not differ markedly from those of 
the group of 50 schizophrenics described in the 
earlier publication. Diagnostic labels, degree of 
morbidity, or duration of illness did not seem 
to vary systematically. Again as noted in the 
earlier investigation, the “dilated” experience- 
type group (high M: high Sum C) proved 
to be somewhat more generally productive and 
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“interesting,” albeit no less disturbed than the 
other subgroups. 


Procedure 


Each S§ participated in five experimental 
situations in more or less the same order. Oc- 
casional changes in sequence were necessitated 
when patients became disturbed or showed 
wandering attention. In all cases the examiner 
(always one of the authors) was unfamiliar 
with patients’ Rorschach scores to minimize 
any unconscious influence on performance. 

1. Waiting-room activity ratings. ‘This pro- 
cedure, modified from a method described by 
Rickers-Ovsiankina [10], was described in a 
previous paper [15]. Thé 8 was conducted in- 
to a waiting room and informed that £ would 
call for him shortly. He was seated near a 
table on which were placed a variety of objects 
and games. The § was then observed for 15 
minutes by means of a one-way vision screen. 
All activity and movements were recorded at 
30-second intervals. These protocols were sub- 
sequently rated by judges on a six-point scale 
for degree of activity and environmental re- 
sponsiveness. The scale itself was simple to use 
and had reasonably high interrater reliability 
[15]. A patient who sat quite still except for 
an occasional shifting of weight or puff on a 
cigarette would obtain in minimal score, while 
an active individual who paced the floor, ma- 
nipulated many of the objects on the table, and 
spoke aloud would obtain a maximum score. 

2. Motor inhibition task. This was a simple 
test modified from Downey’s Will-Tempera- 
ment Scale and employed in previous investi- 
gations of this series [7, 15]. The S was re- 
quired to write the phrase “New Jersey Cham- 
ber of Commerce” as slowly as he possibly 
could without stopping motion or lifting the 
pencil from the page. A sample of writing at 
normal tempo was obtained prior to the experi- 
mental trial to evaluate the extent of S’s effort 
to comply with the instructions. This precaution 
was necessary because of the fairly disturbed 
patient group employed. The data here were 
the times in seconds taken to write the phrase. 

3. Thematic Apperception Test. Cards 1, 2, 
4, 6BM, and 7BM of the TAT were admin- 
istered under two conditions. Initially each § 
was asked to describe each card. After com- 
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pletion of the five descriptions, the cards were 
presented again with the usual instructions to 
make up a story. The protocols were scored by 
means of a modification of Weisskopf’s tran- 
scendence index [17], a measure of the extent 
to which content is introduced into S’s story 
which goes beyond the actual material inherent 
in the stimulus. Additional characters, emo- 
tions attributed to characters, mention of past 
or future events were all scored as transcendent 
items according to a system of thought units. 
A total score for each series was obtained. In 
order to derive a measure of voluntary fantasy 
the difference between the transcendence scores 
for the description and story conditions was 
employed. While other investigators have em- 
ployed more global ratings of over-all creativ- 
ity of themes [13, 16], it was felt here that 
Weisskopf’s transcendence index would be 
most easily quantified and reliably rated. This 
test situation was felt to be a good initial ap- 
proximation of an individual’s capacity to en- 
gage in imaginative behavior, manipulating 
situations, persons, and events “in his mind’s 
eye,” so to speak. The story instructions in ef- 
fect demand of S$ that he adopt an attitude 
toward the “possible,” as Goldstein might put 
it, by introducing situations and persons not 
directly called forth by the card itself. Actual 
verbal fluency is not sufficient here, although 
it bears some relation to the task. Thus, a 
person might present a lengthy, obsessive de- 
scription of the card and of the specific clothes 
or position of the characters yet never obtain a 
single point for transcendence. A story like: 
“This boy’s dreaming of being a great violin- 
ist. If his parents help him and his teacher en- 
courages him he’ll practice hard day by day 
and finally on an evening 20 years from now 
he'll win fame before a Carnegie Hall audi- 
ence,’ on the other hand, while relatively 
short, has a relatively high transcendence score. 

4. Cancellation test. This is a very simple 


procedure based on an unpublished test devised 
by Dr. Seymour Klebanoff. Rows of letters in 
randomized sequence on a printed sheet are 
presented to § who is required to encircle all 
o’s and e’s. He is told to go as rapidly as he 
can but be as accurate as possible. The extreme 
simplicity of the task makes it possible te ob- 
tain a measure of impulsivity by noting errors 


and time, since the task makes little intellectual 
demand on Ss. This test was included chielly 
in an exploratory attempt to observe whether 
Ss with low M and high Sum C would show 
many errors. Perhaps more complex situations 
might have been more discriminating, but pre- 
liminary research with similar patients re- 
vealed that such tasks made considerable de- 
mands on the limited attention of schizo- 
phrenics. 


5. Guilford’s Thinking Introversion Scale 
(Factor T of the Inventory of Factors S IT D 
CR). The items on this scale are described by 
Guilford as defining a factor which involves 
“an inclination to meditative or reflective 
thinking, philosophizing, analysis of one’s self 
and others, versus an extrovertive orientation” 
[5, p. 000]. Certainly this description re- 
sembles some of the propensities of High-M! 
individuals as described in the Rorschach Liter- 
ature. While the inventory was developed with 
college students and has some of the usual limi- 
tations of questionnaires, it was included here 
in an exploratory way to obtain some measure 
of the patient’s self-perception as a thinking in- 
trovert. In the interests of maintaining a 
reasonable time limit and feasible battery of 
tests for this schizophrenic group, only the T 
scale of the inventory was employed. To facili- 
tate administration to this group, items were 
printed on cards and sorted in the manner of 
the MMPI. It must be recognized that these 
deviations from the standardized mode of ad- 
ministration may well alter the test and in- 
crease uncontrolled variability. 


Results 

Table 1 presents pertinent background in- 
formation, Rorschach scores, and results on the 
experimental situations for the High- and 
Low-M groups. Inspection of this table re- 
veals that the general trend of the data is in 
the hypothesized direction. High-M Ss differ 
from the Low-M patients by manifesting long- 
er inhibition times in the writing task, less 
spontaneous activity in the waiting room, great- 
er transcendence of stimulus content in the five 
TAT cards, fewer errors in the cancellation 
task,* and greater tendency toward thinking 

3 The groups did not differ significantly in speed 


of performance although Low-M Ss tended to work 
a little more rapidly. 
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introversion on the Guilford scale. Analysis of 
variance for the motor inhibition times reveals 
an F ratio of 9.6, significant beyond the .01 
level, with the group differences also signifi- 
cant by the ¢ test beyond .01. Waiting-room 
scores also yielded an F ratio of 5.19, signifi- 
cant beyond the .01 level, with the group means 
differing sigaificantly by the ¢ test at the .01 
level. Scores on the transcendence index yielded 
an F ratio of 5.96, significant at the .01 level, 
and again a ¢ test yielded significance beyond 
.01 for the difference in group means. Neither 
the cancellation errors nor the Guilford scores 
yielded significant ¢ or F values although trends 
were evident. Results of these tests, therefore, 
tend on the whole to support the initial hy- 
pothesis. 


Table 1 
Means for High- and Low-M Groups on 


Pertinent Background Data, Rorschach Variables, 
and Experimental Situations 








Groups 





Matching variables High-M group Low-M group 





(N = 28) (N = 32) 

Background variables 
Age 29.6 31.4 
Education (years) 11.7 11.2 
IQ (Wechsler-Bellevue) 111.5 108.2 
Rorschach Variables 
M 2.6 0.3** 
Sum C 2.8 2.7 
FM 4.7 2.1 
Shading 2.6 2.3 
Total responses 25.3 17.3 
Experimeatal situations 
Motor inhibition time 172.21 62.97** 
Waiting-room 

activity score 1.92 3.13°° 
TAT transcendence index 21.96 12.69** 
Cancellation test errors 3.00 4.25 
Guilford Factor T scale 39.42 36.25 





**Differences between groups significant beyond the 
01 level. 


As to the specific prediction concerning the 
spontaneous motor activity in the waiting 
room, Table 2 reveals a regular increase in 
activity scores as the groups change from high 
M: low Sum C through low M: high Sum C. 
This result is strikingly similar in trend and in 
actual scores to the results obtained with the 
population in the previous study [15]. This 
relationship between overt response and the M: 


Sum C ratio emerged only for the waiting- 
room scores. 


Table 2 
Means of Waiting-Room Activity Ratings 
for High- and Low-M Ss Subdivided 
by Sum C Scores 








Rorschach Waiting-room 





Group N variables activity 

M SumC ratings 
High M: Low C 14 2. 1.2 1.58 
High M:HighC 14 3.2 4.9 2.29 
Low M: Low C 18 0.4 1.2 2.89 
Low M:HighC 14 0.3 5.2 3.43 


| 
| 
| 
| 
I 





The next phase of the analysis of results 
involved testing the hypothesis concerning the 
consistency of Ss from situation to situation. 
Two methods for ascertaining whether a com- 
mon factor underlies M/ and the five experi- 
mental situations were employed. The first of 
these was Blomgvist’s test of relatedness [3], 
a nonparametric method which provides a ¢ 
test of the significance of concomitant variation 
of two or more tests for a common population. 
It involves dichotomization of all test scores 
into high and low and makes no assumptions 
concerning the distributions. For this reason it 
is useful with Rorschach data and particularly 
where the range of scores is quite limited, as 
in the case of the M response in this group of 
schizophrenics. The technique does not, of 
course, provide the precise information avail- 
able from a factor analysis which affords an 
estimate of the degree of relationship and of 
the factor loadings of the various subtests. 

Applying Blomgvist’s test to the distribu- 
tion of M, treated as one of a battery of tests, 
and to the five experimental situations results 
in a ¢ of 8.48, significant beyond the .001 level. 
This finding suggests that the six sets of scores 
are indeed grossly related. To evaluate the ex- 
tent to which all experimental situations share 
in this concomitant variation, Blomgvist’s 
test was applied to the six sets of scores in pairs 
yielding the matrix presented in association 
with # values in Table 3. It is apparent from 
inspection of this table that a common factor 
must indeed subsume M and these seemingly di- 
verse test situations. Only the Guilford scale 
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fails to show uniformly significant p values for 
relatedness with the other tests. 


Table 3 


Matrix of » Values for Paired Experimental 
Situations Based upon Application of Blomqvist’s 
Test of Relatedness 











1 2 3 4 5 6 





1.M <.01 <.01 <.05 <.01 >.01 
2. Motor 

inhibition <.01 <.01 <.05 <.05 >.20 
3. Waiting 

room <.01 <.01 <.01 <.05 >.20 


4. Transcen- 


dence <.05 <.05 <.01 <.01 >.20 
5. Cancella- 
tionerrors <.01 <.05 <.05 <.01 <.01 


6. Guilford’s 


FactorT <.01 >.20 >.20 >.20 <.01 





The application of Blomavist’s test would 
thus appear to offer support to the second gen- 
eral hypothesis of this investigation. The next 
step in evaluation of the data involved the calcu- 
lation of product-moment correlations be- 
tween Rorschach variables and the experimen- 
tal situations. This procedure was employed 
with some trepidation because of the unknown 
quality of Rorschach distributions, the ex- 
tremely restricted range of M and other vari- 
ables in this sample, the limited N, and, finally, 
the inevitable interrelationship of M and the 
total responses (R), which cannot legitimately 
be eliminated by partial correlation since the 
two variables are not experimentally inde- 
pendent. In line with Wittenborn’s reasoning 
[20], however, the extraction of a centroid 
factor by Thurstone’s multiple factor analysis 
was carried out in a general attempt to test the 
hypothesis of commonality. The advantage of 
this method is that some indication of extent 
of association could be obtained. Other Ror- 
schach variables bearing on the common factor 
might also be expected to emerge. 


Calculation of Pearson product-moment r’s 
for IQ, variables on the Rorschach, and the 
five experimental situations revealed relatively 
few significant correlations with the exception 
of the matrix of M and three of the experi- 
mental situations, motor inhibition, waiting 
room, and the TAT transcendence index. 


Other variables like FM, the Guilford, and 
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cancellation error scores showed trends in the 
expected direction, but the correlation coefh- 
cients did not reach significance. Extraction of 
centroid factors for those variables which, fol- 
lowing a cluster analysis, showed sufficient 
significant interrelations revealed one clear fac- 
tor which had its highest loadings from M and 
the motor inhibition times (Table 4). These 
findings tend to offer partial support to the 
second hypothesis. It is hoped that further re- 
search with larger groups and normal Ss who 
may be expected to show a greater range of M 
responses will provide a more suitable test of 
this hypothesis using the factor analytic ap- 
proach. 


Table 4 


Matrix of Intercorrelations for M and Three 








Variable 1 2 3 4 





1.M 


2. Motor inhibition 539 —.244 293 
3. Waiting-room activity -.270 -.244 ~.077 
4. TAT transcendence 
index -347 .293 -.077 
Centroid factor 
loadings 


749 .714 .376 465 


A final use of correlation was attempted to 
evaluate the role of the color variables. Al- 
though Sum C and the separate color scores did 
not yield any significant relationships with 
other variables, inspection of Table 2 suggests 
that at least for waiting-room activity ratings 
some correlation between the 7: Sum C ratio 
and experimental situations must exist. Scores 
from 1 to 4 were assigned to the High-M/: 
Low-Sum C, High-M: High-Sum C, Low-M: 
Low-Sum C,and Low-M : High-Sum C groups 
in that order. Calculation of product-moment 
r’s for this M: Sum C score and the experimen- 
tal situations revealed no changes or lowering of 
their correlations with M alone. The correla- 
tion for the waiting-room scores and this vari- 
able was + .47, almost twice that obtained 
when M alone was involved. Thus there seems 
to be here a hint of validity to Rorschach’s 
linkage of movement and color, and further ex- 
ploration with other behavioral correlates 
clearly seems warranted. 


Discussion 
The data of this investigation on the whole 
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lend support to the view that a person’s capac- 
ity or tendency to control overt motor activity 
is related to his capacity for imaginative or fan- 
tasy activity. Rorschach’s human movement 
determinant may indeed be a gross but valid 
measure of these alternative response tenden- 
cies. While specific predictions in the individual 
case are not warranted from the results pre- 
sented here, it is clear that this motor inhibi- 
tion—fantasy dimension merits more extensive 
exploration. Should further experimentation 
extend the scope of this triadic relationship of 
motion perception, motor response, and imagina- 
tion to other behavioral situations or to other 
populations, a new approach to understanding 
an important phase of personality development 
may be opened. Can it be shown that control 
of motor response, or, more generally, post- 
ponement of gratification is accompanied by in- 
creased activity on what Lewin [6] has termed 
the “level of irreality” ? At least in moderation 
such control has great functional value for 
man. The ability to defer immediate motor re- 
sponse directed toward need gratification with 
the consequent resort to the realm of fantasy 
gives man a control of his future through 
imagery and planning. Indeed such a pattern 
of postponement of immediate effort and evolu- 
tion of a timeless behavioral space available for 
what Freud [4] has called “experimental ac- 
tion” may well be one of the key phases of 
maturation and, more broadly, civilization. It 
may also make possible a medium for experi- 
encing anxiety unknown to animals or primi- 
tive man. Rorschach’s M response is significant 
insofar as it serves as a measure of presumably 
long-standing personality characteristic reflect- 
ing this pattern of motor control and enhanced 
fantasy. Perhaps in a more refined and readily 
quantifiable form‘ this threshold for perception 
of humans in motion may serve as a valuable 
clue to important response tendencies that may 
differentiate not only pathological groups but 
diverse subcultures within our society. The 
“deferred gratification pattern” often repre- 
sented as characteristic of American middle- 
class values might well be explored by tests of 
the type used here or more complex extensions 
of them. Of interest might be an attempt to 


*A promising attempt in this connection was re- 
ported recently by Barron [2]. 
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link early parental training or perceptions of 
familial figures to the development of the M 
response and its behavioral correlates. 


Summary and Conclusions 


Previous studies in this series had demon- 
strated significant relationships between Ror- 
schach human movement responses and meas- 
ures of motor inhibition and spontaneous motor 
activity, thus affording partial support for Ror- 
schach’s postulated relationship of overt motor 
activity, perception of motion, and fantasy. 
The present investigation was designed as a 
partial replication of earlier work and an ex- 
tension to include measures of fantasy or 
imaginative capacity as well as motor activity. 
It was hypothesized that Ss differing in Ror- 
schach M productivity would differ on tasks 
tapping motor control and fantasy. It was also 
anticipated that they would manifest rough 
consistency in their performance on the motor 
and fantasy situations in support of the general 
theory of vicarious motor, sensory, and fartasy 
functioning. 


Sixty male schizophrenic patients who had 
recently been administered Rorschachs under- 
went five experimental procedures. The Ss 
were divided into High- and Low-M groups 
on the basis of Rorschach protocols, two M or 
more being the dividing point. High-M Ss 
(N = 28) did not differ significantly from 
Low-M Ss (N = 32) in age, diagnosis, educa- 
tion, IQ, or other pertinent Rorschach vari- 
ables. The experimental situations were: (a) 
observation of Ss alone in a waiting room with 
ratings of the degree of activity manifested ; 
(4) a motor inhibition task, ability to write a 
phrase as slowly as possible; (c) Thematic Ap- 
perception Test stories scored for transcend- 
ence, i.e., introduction of content not actually 
represented in the stimulus; (d) Klebanoff 
cancellation test scored for errors; (e) Guil- 
ford’s scale for the thinking introversion fac- 
tor (T) from the Inventory of Factors ST D- 
CR. Analyses of variance and ¢ tests were em- 
ployed to evaluate significance for the individ- 
ual tests. Correlational procedures and Blom- 
qvist’s nonparametric test of relatedness were 
employed to evaluate consistency of perform- 
ance from test to test. 


Results on the whole supported both general 
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hypotheses. High-M Ss differed significantly 
from Low-M Ss by manifesting longer motor 
delaying capacity, less spontaneous activity dur- 
ing the waiting period, and more frequent in- 
troduction of characters or incidents not direct- 
ly represented in TAT stimuli. They showed 
nonsignificant trends to make fewer cancella- 
tion errors and to present greater self-descrip- 
tion as thinking introverts than did Low-M 
patients. For the waiting-room spontaneous 
activity, the relationship of Rorschach color 
and movement proved to be particularly im- 
portant, replicating a finding in an earlier 
study. With Blomavist’s test, a significant in- 
terrelationship of M and the five experimental 
situations emerged, suggesting the presence of 
a common factor underlying the six sets of 
scores. Extraction of a centroid factor from a 
matrix of those intercorrelations which reached 
significance revealed fairly high factor loadings 
for M, waiting-room activity scores, motor in- 
hibition, and TAT transcendence. The factor 
analytic procedure, although based on not very 
tenable statistical assumptions for this sample 
and these distributions, also appears to lend at 
least partial support to the hypothesis that a 
common dynamic factor underlies motor con- 
trol, motion perception, and fantasy behavior. 


Received January 14, 1954. 
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The Ammons FRPV Test and the WISC for 
Remedial Reading Cases’ 


Louis M. Smith and Arline R. Fillmore 


Psycho-Educational Clinic, University of Minnesota 


The Ammons Full Range Picture Vocabu- 
lary Test and the Wechsler Intelligence Scale 
for Children were given to 91 children diag- 
nosed as reading disability cases at the Psycho- 
Educational Clinic. A reading disability was 
defined as a reading grade level, on a standard- 
ized achievement test, at least one year below 
the mental grade level on either the WISC or 
the Stanford-Binet. Eight of the subjects were 
girls and 82 were boys. The mean chronologi- 
cal age was 10.9 years, the mean reading grade 
was 3.2 years, and the mean intelligence level 
on the WISC was 101. Most of the children 
received both tests in the initial diagnostic in- 
terview, but some were given the Ammons 
while they were enrolled in the summer read- 
ing school. 


Form A and Form B of the Ammons were 
comparable in mean and standard deviation. 
When combined the mean was 107.89, the 


standard deviation was 13.70. The mean of 
the WISC Verbal Scale was 99.66, Perform- 
ance Scale 101.87, and Full Scale 100.85. The 


1An extended report of this study may be ob- 
tained without charge from Louis M. Smith and 
Arline R. Fillmore, Psycho-Educational Clinic, Uni- 
versity of Minnesota, or for a fee from the American 
Documentation Institute. To obtain it from the lat- 
ter source, order Document No. 4321 from ADI 
Auxiliary Publications Project, Photoduplication 
Service, Library of Congress, Washington 25, D.C., 
remitting in advance $1.25 for microfilm or $1.25 
for photocopies. Make checks payable to Chief, 
Photoduplication Service, Library of Congress. 


standard deviations were respectively 10.87, 
12.51, and 10.71. The correlation between 
Form A and Form B of the Ammons was .90. 
The two forms were combined into a single 
scale and then correlated with the WISC 
scales. The correlations were .73 with the 
Verbal Scale, .54 with the Performance Scale, 
.75 with the Full Scale, and .61 with the scaled 
score of the Vocabulary subtest. When the cor- 
relation between the combined forms of the 
Ammons and the WISC Full Scale was cor- 
rected for the restriction of range on the 
WISC, the value was raised to .82. 

In conclusion, the present writers feel that 
the Ammons is a useful screening test of intel- 
ligence for children with reading handicaps. 
The differences in mean scores indicate a pos- 
sible limitation. However, the full significance 
of this cannot be fully weighed at the present 
time. Krugman, e¢ al. [1] reported differences 
between the WISC and the Stanford-Binet 
similar in magnitude and direction to the pres- 
ent differences between the WISC and the 
Ammons. 


Brief Report 
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A P Scale for the Rorschach: 
A Methodological Study 


Philip H. DuBois and Arnold H. Hilden 


Washington University 


The present study represents t..e application 
of a relatively new method of item analysis 
[3, 6] to Rorschach data. It can be readily 
shown that the total variance of a test can be 
divided into two parts: the sum of the item 
variances and the sum of all the covariances 
among the items. The total variance of a test 
with zero intercorrelations among the items, 
and hence zero interitem covariances, would 
be the sum of the item variances. Each item 
would then have nothing in common with the 
other items. The test would be completely 
heterogeneous, measuring different qualities 
rather than a single quality. It would be impos- 
sible to give a name to such a test, unless it 
predicted a criterion similarly heterogeneous. 
In that case its unity would come from with- 
out rather than from within. 


In general, a psychometric test should be de- 
signed to measure a unitary characteristic, re- 
vealed by positive intercorrelations among the 
items. If these correlations are too high and ap- 
proach unity, the test makes too few discrimi- 
nations to be of value. With the type of mater- 
ial used in the present study, however, this dif- 
ficulty was not encountered. Our procedure for 
selecting items was to maximize the saturation, 
defined as the ratio of the sum of the item co- 
variances to the total variance of the test. This 
formula may be written as follows: 





eg ae 
$=1 «=j=t+1 
s= o, 
a o’, é: o’; 


in which C;; represents the covariance between 
any two items, and o’, is the total variance. 
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‘of subjects . . 


It is readily apparent that maximizing the 
saturation is essentially the same operation as 
maximizing the internal consistency as esti- 
mated by Kuder-Richardson Formula 20. We 
can convert a saturation coefficient into r;; by 
multiplying by 2 in which n is the number 





a= 3 
of items. 

It occurred to us that this procedure offered 
promise as a method of scaling Rorschach vari- 
ables. Rorschach literature, while voluminous, 
has not drawn heavily on conventional psy- 
chometric methods. 


The popular response, P, was defined by 
Rorschach [8, p. 359] as follows: “The vul- 
gar answers represent the share in the collec- 
tive or common method of sensing anything.” 
Subsequently, a number of authors have ex- 
pressed various definitions or rationales under- 
lying the popular concept. Hertz [4], Beck 
[1, 2], Klopfer [5], and Rapaport [7], among 
others, have proposed different P lists. All, in- 
cluding Rorschach, define P on a definitely 
statistical basis. It is one of the few Ror- 
schach categories so defined. There is, how- 
ever, variation as to the exact statistical cri- 
terion. Klopfer says [5, p. 177] that “the term 
popular refers to . . . responses given most fre- 
quently . . . to a particular blot area” and “‘it 
seems most reasonable to use the total number 
. as a basis for determining the 
frequency with which a concept has been se- 
lected.”” He states that since a frequency tabu- 
lation of universal validity is not available, he 
has substituted a selected sample of popular 
responses which meet four qualifications: (a) 
they must occur frequently; (4) frequently 
used determinants must be present; (c) any 
“normal” person should be able to accept them; 
and (d) a D or W must be involved. 
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Beck insists that P is based on form alone. 
Rapaport gives no exact criterion, but states 
that “they must occur in at least every 4 or 5 
records” [7, p. 313]. Hertz [4] uses a definite 
statistical basis. Beck [2] has used the most 
definite and elaborate basis, and has made 
the most exhaustive attempt to arrive at cri- 
teria for establishment of P responses. 


In the present study the lists proposed by 
these four authors were taken as representative 
of populars used in clinical practice in this 
country. The four lists were combined into a 
composite list of 47 items, many of which were 
alternates or variations of others on the list. 
While the four authors are not in complete 
agreement on any item, the list was drawn up 
so that each of the four authors was fully rep- 
resented. 


Subjects 


The subjects consisted of 200 normal adults, 
normal in the sense that they were not clinic 
patients. Most of them were tested by gradu- 
ate students enrolled in a projective technique 
course, while the others were tested by one of 
the authors. 


The population, consisting of 100 males and 
100 females, was randomly divided into two 
groups, Group A, an experimental group, and 
Group B, a cross-validation group. Mean ages 
were 31.6 and 30.4 years, respectively. 


Procedure 


For Group A, the entire matrix of item var- 
iances and covariances for 47 items was com- 
puted. Saturation and internal consistency re- 
liability coefficients are reported in Table 1 for 
the scales proposed by the four authors, in the 
two groups of 100 each and for the combined 
group of 200. For these scales, variation in 
saturation and reliability from Group A to 
Group B comes merely from sampling, since 
no maximizing is involved. Of the four scales 
proposed, Beck’s has the highest internal con- 
sistency, .47, Klopfer’s the lowest, .22. Even 
with Beck’s scale, however, the internal con- 
sistency is lower than we would wish to have 
in a good psychometric device measuring a 
quantifiable aspect of human behavior along a 
continuum. 


In order to develop a homogeneous scale of 
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Table 1 


Saturations and Reliabilities (by Kuder- 
Richardson Formula 20) of the Several P Scales 














Group A GroupB Combined 
Author n me Ose 2 Oe Ol ie 
Beck 21 48 51 41 43 45 47 
Hertz \ oo |) a co ee 
Klopfer so HUT He DE 


Rapaport Ss 2 & 35 3S 8 
Saturation S82 2 HA. & 





Rorschach populars, the entire collection of 47 
items was considered as a source of possibilities. 
However, a number of the items, as indicated 
in Table 2, were considered as overlapping, 
representing definitions by different authors of 
the same general idea. Accordingly, only one of 
the items in such a group of “overlapping” 
was considered for inclusion at any one time. 

A nucleus of four items having the highest 
available interitem covariances was selected as 
a starting point. This nucleus consisted of 
items 1, 13, 19, and 23, as listed in Table 2. 
At each stage in the development of the satura- 
tion scale, all items were tested for inclusion 
in or exclusion from the nucleus. 

It has been shown [6] that any item, j, not 
included in the nucleus, will add to the satura- 
tion if 

2Ce; + a; co’. 
o*; 20"; 


On the other hand any item, 4, included in the 
nucleus, should be removed if 





a’, > 2Cx ee o** 


20"; ox 





A peculiar problem was encountered in the 
construction of the present scale in the matter 
of alternative possibilities, that is, different de- 
finitions of the same general idea. Accordingly, 
a formula was developed to determine whether 
any specific interchange would add to the 
saturation. 


If j is any item in the nucleus and & is any 
item outside the nucleus, the saturation will 
be increased if the following inequality holds: 

o*, (0; ig o*;) > Dao"; (2C% + 2C,; 

sass 2Cx wate o*; ce o*;). 
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Table 2 
Composite P List 
Item Percentage Card and 
no. passed** locationt Sourcet Content of the popular responses 
A B 
1§ 58 55 i, W BHKR Bat, butterfly, moth (R omits moth) 
2 + 1 I, W H Bird (also item 1) 
3 2 5 I, W K Winged creature (also item 1) 
4 61 61 I, W K Items 1, 2, and 3 combined (generic concept) 
5 1 0 aT H Face of a person (not animal or cat) 
6* 10 11 I, D3 B Lower part of body (D4 if D3 attended to) 
7 18 21 Il, WV,% BH R Human being 
x 0 1 Il, W, R Bear, dog 
9° 31 33 Il, Di i Bear, dog 
10 32 40 Ii, Di, 7 H Bear, dog, cow, animal 
il 33 35 Il, Di K Bear, dog, rabbit, bull, rhinoceros variety 
12* 17 17 Il, D3 B Butterfly, moth 
its 68 83 Ill, D1,9 B R_ Human beings (with or without M) 
14 66 79 Ill, D1,9 HK Human beings (only if M is present) 
Jas 21 20 Ill, D3 B Bow, bow-tie, hair ribbon 
169 32 36 Ill, D3 HKR Butterfly, or item 15 
17 46 35 IV, W BH R Animal skin 
18 7 17 IV, D2,6 H Boot, foot, shoe 
19* 77 86 V, W BHKR Bat, butterfly, moth (R omits moth) 
20 4 6 "sev H Bird (also item 20) 
21 90 92 Ff K Winged creature, or items 19 or 20 
22° 12 17 V, Di B Leg, animal or human 
{23 51 65 VI, W, D1 BH R_ Animal skin (F only or with shading) 
lage 37 46 VI, W, D1 K Animal skin, only when shading is present 
25° 51 51 Vil, Di BH R Face or head of human (also if D2, /., W used) 
26 69 67 VIII, D1 B Animal (Beck’s list) 
27 89 83 VIll, D1 H Animal (Hertz’s list) 
28 51 50 Vill, Di K Four-legged animal, with FM 
29 93 90 VIII, Di R Animal 
30* 21 24 VIII, D3 BH Vertebrae, ribs, bone structure 
31 6 9 VII, D4 BH Tree, bush 
32° 19 20 IX, D3 » 2 Human being 
{33 14 17 IX, D4 B Face, head; of a man 
34* 16 17 IX, D4 H Face, head; person, not female 
35* 16 20 IX, D2 H Face, head; of animal (Hertz’s list) 
36 1 3 1X, D9 H Tree 
37* 52 41 X, Di B Spider, crab, lobster, crustacean 
38 54 39 X, Di H Spider, crab, octopus, crustacean 
39 33 25 X, Di R Crab, octopus 
40 58 46 X, Di K Many-legged animal, or items 37, 38, 39 
41° 17 14 X, D2 B Dog 
42|| 21 24 X, D4 Worm, caterpillar, serpent (F or FC) 
{43 26 34 X, D4 H Seahorse, or item 42 
44 18 20 X, D4 K Elongated animal, with use of color 
45° 21 29 X, DS BH R_ Rabbit head 
46 24 33 X, Ds K Animal head with ears or horns, or item 45 
47* 9 11 X, Di2 B Sheep 





* Items remaining in the maximum saturation scale. 
** Each group consists of 100 cases. 
t Under “Location,” numbers refer to Beck’s D notation. 
+ Capital letters refer to Beck, Hertz, Klopfer, and Rapaport, respectively. 
§ Parentheses indicate overlapping items. 
{ Item 16 not correct as to Hertz; noted too late to change. 
| Item 42 belongs to no author; inserted to test with or without color. 
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Of the 47 items considered, 18 yielded a 
saturation of .63 in the experimental group. 
This was the maximum saturation possible, 
usin z no more than one of any group of “over- 
lapfting” items. These 18 items are designated 
with asterisks in Table 2. 

Strce a maximizing procedure was em- 
ploysd, the true characteristics of the P scale 
so developed should be estimated from Group 
B. Here the saturation is .51 and the reliability 
as estimated by Kuder-Richardson Formula 20 
is .54. This was the highest internal consist- 
ency sueasure found for any of these scales, but 
obviously leaves much to be desired. 











Table 3 
Intercorrelations of P Scales 
(N = 200) 
——— - 
he S S 
N & - ~ M o 
Author 2n 5 = é. 5 
ms 6 OM x a 
Beck 21 .88 71 .86 88 7.06 2.62 
Hertz 20 76 82 $3 7.12 2.22 
Klopfer 10 68 .73 4.285 1.61 
Rapaport 13 71 5.80 1.81 
Saturation 18 5.61 2.73 





The intercorrelations of the five P scales for 
the entire group of 200 cases are given in 
Table 3. All have a great deal in common, as 
shown by the intercorrelations, none of which 
is lower than .68. High intercorrelations are 
to be expected because of overlap in rationale 
of the items and in actual item content. The 
saturation scale correlated .88 with Beck’s, 
with which it has much content in common. 
Identical content makes all these intercorrela- 
tions high. It is of interest that in all but one 
of the items included in the saturation scale the 
determinant was form only. This may have 
some bearing on the point of view put forth by 
some authorities that determinants other than 
form should sometimes be considered in the se- 
lections of populars. In this connection, the 
question sometimes occurs as to whether the 
responses included as a popular should be de- 
fined quite specifically or in rather generic 
terms. For example, in Card 1 for the whole 
card, should one accept merely the bat, the 
butterfly, and the moth, but not a bird or a 
winged creature as a generic term? There are 
a number of points for which such a question 
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could well arise. This point was tested during 

the investigation by replacing more specific 

terms by the more generic ones. In no instance 

was the saturation affected by more than a 

point or two. 

Conclusions 

Of the lists of populars proposed by four 
authors, Beck’s scale exhibits the highest in- 
ternal consistency. Its reliability, however, is 
definitely lower than that of acceptable psycho- 
metric devices. A revised list of 18 items, de- 
veloped during the present investigation, is a 
slight improvement over Beck. 

The present study indicates that orthodox 
psychometric methods can be used with projec- 
tive material and will aid in the improvement 
of posited variables. ‘The authors of this paper, 
a practicing clinician and a worker with con- 
ventional tests, were both surprised by the out- 
come. Ihe internal consistency of the P scale, 
as developed by saturation analysis, was neither 
as high as the clinician expected nor as low as 
the psychometrician believed. 

Variables which have a high degree of in- 
ternal consistency may or may not be useful. 
Variables which have neither internal consist- 
ency nor external validity are certainly use- 
less. It would appear that further examination 
of Rorschach variables is indicated. 

Received February 22, 1954. 
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Sex, Age, and Iconicity as Factors in 
Projective Film Tests’ 


Charles J. McIntyre 
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This study was undertaken to investigate 
the probable effectiveness of sound motion pic- 
tures as a medium for projective personality 
testing, and to attempt to define some of the 
characteristics which should be built into such 
a test. 


Previous studies [2, 4, 5] have indicated 
that specially produced films may provide a 
powerful new tool for personality assessment. 
No attempt was made in these studies, how- 
ever, to demonstrate that films might be superi- 
or to any conventional or widely used projec- 
tive test, the Thematic Apperception Test 
(TAT), for example. Such a demonstration 
appears to be necessary if one is to justify the 
cost of producing a new test. Nor has any sys- 
tematic attempt been made previously to in- 
dicate what characteristics such films should 
have in order to be maximally effective. 

A related consideration involves the desira- 
bility of developing a criterion measure which 
not only would permit evaluating the limited 
variables tested in this study, but which could 
serve as a relatively quick and simple method 
for evaluating each of many stimulus charac- 
teristics that should be evaluated before con- 
structing a motion picture projective test. 

Since the success of picture projective tests 
appears to be dependent upon the degree to 
which subjects’ (Ss’) interpretations of the 
stimuli are projections of their own personali- 
ties, the variables were evaluated in terms of 


1 This paper represents the substance of a dis- 
sertation submitted in partia’ fulfillment of the re- 
quirements for the Ph. D. degree at the Pennsylva- 
nia State University. 

2 This research was carried out under contract 
No. Néonr-269, T. O. VII between the Instructional 
Film Research Program, The Pennsylvania State 
University, and the Special Devices Center, Office 
of Naval Research. 
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the relative degree to which they permitted or 
encouraged projection onto the central figure 
(hero, protagonist). 

The emphasis, which appears again and 
again in TAT literature, upon making the cen- 
tral figure like S with respect to age, sex, 
color, body-build, etc., in order to increase pro- 
jection is directed to the end of making it 
possible for § to perceive the protagonist as be- 
ing like himself. In fact, this appears to be the 
central meaning of projection in this context; 
namely, that an § has projected to the extent 
that his reported perception of the protagonist 
agrees with his perception of himself. This is 
the operational definition of projection used 
throughout this study. 

The following hypotheses were tested. 

1. There is a greater than chance agreement 
between an S’s perception of himself and his 
perception of an ambiguous film protagonist. 

This hypothesis means, in terms of the oper- 
ational definition, that persons viewing an am- 
biguous film will project their own self-percep- 
tions onto the protagonist. 

2. Provided that the total picture remains 
ambiguous, the amount of projection elicited 
by a protagonist will increase as the iconicity 
of the protagonist increases. 

Iconicity is a term borrowed from semantics. 
It is used here to mean something akin to life- 
likeness or realism. Apparently, the peculiar 
advantage of pictures, and especially motion 
pictures, over other forms of representational 
art is the great realism with which persons or 
things can be portrayed. 

3. The Ss will project more onto protago- 
nists of the same sex than onto protagonists of 
the opposite sex. 

4. The Ss will project more onto protago- 
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nists of the same apparent age as the Ss’ 
than onto protagonists whose apparent age is 
different from the Ss’. 

Hypotheses 2, 3, 4 are all based upon the as- 
sumption that increased subject-protagonist 
similarity will result in increased projection. 
In hypothesis 2 the element of similarity is, of 
course, realism or lifelikeness. It says, in effect, 
that the probability for projection occurring is 
increased as the protagonists become more like 
real people and less like paintings or still pic- 
tures of people. 

The assumption that increased similarity re- 
sults in increased projection permeates the 
TAT literature. It was made specifically by 
Murray [7], Thompson [12], and Symonds 
[11]. It is implicit in the studies of Crandall 
[1], and Heppell and Raimy [6] when, in 
selecting pictures to elicit information in 
specific areas, they were careful to stipulate 
that at least one character in their pictures be 
of the same sex and age as the persons to be 
tested. In addition, among the rules set forth 
by Rotter for determining onto which figure 
an § is projecting, one finds, “The subject is 
likely to identify with a character of the same 
sex, either one of his own age or a previous 
age. For example, a young male adult might 
identify with a young male adult or a boy in 
the story but would be unlikely to identify 
himself with an older person, or a female of 
any age” [9, p. 82]. “Identify” in this context 
apparently means to project one’s own charac- 
teristics onto a particular figure in the card. 

It should be noted, however, that this as- 
sumption is not supported by the findings of 
Riess, Schwartz, and Cottingham [8, 10] and 
Weisskopf and Dunlevy [13, 14] which, while 
they do not indicate what conditions are neces- 
sary for eliciting maximum projection, do in- 
dicate that, whatever the necessary conditions 
may be, they are more subtle than simple 
physical similarity. 


Procedures 

The films. In all treatments, the stimulus 
materials were 16-mm. motion pictures which 
from the beginning of the fade-in to the end 
of the fade-out were each 35 seconds long. 
Five film versions were produced for each of 
five scenes, plus an additional film which was 
shown at the beginning of each experimental 
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session as a practice exercise. Thus, there was 
a total of twenty-five different experimental 
films plus one practice film. 

The five experimental scenes upon which 
the versions were built were selected from five 
TAT cards so as to embody the sex and age 
variables of the study. Since it was essential 
to duplicate as nearly as possible these scenes 
in the motion pictures, the selection of cards 
was limited, in that it was necessary to find 
persons who looked like the TAT characters 
they were portraying, and to find locations 
for shooting which were like those of the cards. 
An additional limiting factor was the necessity 
of selecting scenes in which the pose was rela- 
tively static rather than one implying action. 
The action versions of the scene had to con- 
form to the general principle of ambiguity, and 
it was found in planning the scripts that any 
action coming before or after a dynamic still 
pose tended to define the meaning of the scene. 
When a pose was essentially static it was rela- 
tively easy to get an actor into or out of that 
pose without giving definition to the scene. 
With these limitations in mind, the following 
scenes were selected as the variables to test the 
age and sex hypotheses: 

Scene 1. Variable: Young boy (TAT Card 1) 
A young boy is contemplating a violin which rests 
on a table in front of him. 

Scene 2. Variable: Young man (TAT Card 20) 
The dimly illumined figure of a man (or woman) 
leaning against a lamppost in the dead of night. 

Eron [3] in his normative study of the TAT 
found that 20 per cent of nonhospitalized Ss mis- 
identified the figure in card 20. To avoid contam- 
inating the data because of misidentification, $s who 
were tested with this scene in the present study 
were required to indicate the sex and approximate 
age of the figure. Those who did not identify the 
figure as that of a young man were eliminated in 
the statistical analysis. 

Scene 3. Variable: Young woman (TAT Card 8- 
GF) A young woman sits with her chin in her hand 
looking off into space. 

Scene 4. Variable: Old man (TAT Card 7BM) 
A gray-haired man is looking at a younger man who 
is sullenly staring into space. 

Although there are two persons in this scene, Ss 
were told to make their judgments about the old 
man only. 

Scene 5. Variable: Old woman (TAT Card 6BM) 
A short elderly woman stands with her back turned 
to a tall young man. The latter is looking downward 
with a perplexed expression. 


As in Scene 4, there are two persons in this scene. 
The Ss were told to make their judgments about the 
old woman only. 
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Scene 6. The practice scene shown to all groups 
(TAT Card 14). The silhouette of a young man 
(or woman) against a bright window. The rest of 
the picture is totally black. 

The variable of iconicity was built into the 
five motion picture versions of each of the five 
scenes. Iconicity has been defined as lifelike- 
ness or realism. In the development of the ver- 
sions, an attempt was made to keep each suc- 
cessive version of a particular scene as nearly 
identical as possible, while adding elements 
that would make the characters more real or 
more lifelike than in the preceding version. 
Thus, Version 1, a photograph of a TAT card, 
was the least iconic since the figures in the 
card were merely drawn representations of 
people. The figures in Version 2 were more 
lifelike in that they were photographs of real 
people rather than drawings. In Version 3, the 
characters moved into the scene and thus were 
endowed with another attribute of real people, 
i.e., motion. Version 4 extended the principle of 
Version 3, that is, the characters manipulat- 
ed and interacted with their environment. Ver- 
sion 5 attempted to add another dimension of 
behavior associated with people, namely, speech. 
Since the speech in Version 5 was made un- 
intelligible in order to retain ambiguity, it may 
be that this version was actually less lifelike 
than the other versions rather than more, as 
intended. However, it can be seen that the in- 
tent in each case was to add increments of life- 
likeness to each succeeding version in order to 
make the characters more like real, living 
people than in the preceding versions. 

The measure of projection. For the purpose 
of this study projection has been operationally 
defined as the degree to which an individual’s 
perception of a film protagonist agrees with his 
perception of himself. The Minnesota Multi- 
phasic Personality Inventory (MMPI) was 
used as a pool from which items were drawn 
to sample Ss’ perception of the protagonist and 
their perception of themselves. That is, after 
the film sequence was shown, Ss were asked 
to answer true or false to 26 questions which 
read, for example, “This is the sort of person 
who feels more intensely than most people do.” 
After responding to these perception-of-protag- 
onist questions, Ss then took an MMPI for 
themselves during the course of which they 
would answer an item which read, “I think 


that I feel more intensely than most people do.” 
When an S’s answer to the question with respect 
to the protagonist was the same as his answer 
with respect to himself, this was scored as a 
“unit of projection” and the sum of these was 
his “projection” score. 

The full MMPI, rather than just the per- 
tinent 26 items, was administered in order to 
obscure from Ss the relationship between 
the items in the film test and the items in the 
inventory. 

The items of the perception-of-protagonist 
test (the film test) were selected from the 
MMPI by two persons working independent- 
ly. Only those items were used which both 
agreed met the following criteria: 

1. The item should not be objectively answerable 
from the film. That is, there should be nothing about 
the appearance or action of the protagonist which 
would suggest a “correct” answer. 

2. An item should not have a distinctly “abnor- 
mal” answer. Thus an item such as “Someone has 
control of my mind” although perhaps suitable ac- 
cording to criterion 1, would be. unsuitable, since 
most people would answer this false for themselves 
and false for the protagonist merely by inference 
and thus, by the measure, be “projecting” with re- 
spect to this item. 

3. In the interest of subject cooperation and 
motivation an item should have the appearance of 
being answerable from the film. An item such as, 
“My hands and feet are usually warm enough” 
would be rejected since an § would be likely to feel 
that he could not reasonably be expected to answer 
this item with respect to a film protagonist 

4. Items should be drawn from various scales of 


the personality inventory in approximately equal 
number. 


The numbers of the 26 MMPI items used 
with each of the sequences were: 8, 13, 26, 32, 
39, 54, 64, 79, 82, 91, 93, 94, 102, 165, 171, 
242, 257, 267, 292, 299, 336, 362, 371, 399, 
407, 416. 

The subjects. The Ss were 425 college 
students in elementary courses in education, 
psychology, and sociology. They were assigned 
randomly to the treatments. Each S saw only 
one of the twentv-five different sequences. 
Hence, the total subject pool was divided ran- 
domly into 25 groups of 7 men and 10 women 
each. 

Test administration. The screen image was 
held constant at 5814 inches wide and 44 inch- 
es high. The arbitrary image size was dictated 
by the size of the smallest room (and therefore 
minimum projector-to-screen distance) avail- 
able for the experiment. 
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In summary, the Ss were told that it is well 
accepted that one of the chief characteristics 
of motion pictures is their ability to portray 
complex human emotions, feelings, and inter- 
actions, but that the ability of the actors is 
only one aspect of this. This experiment, they 
were told, was being conducted to find out 
about another aspect, namely, the ability of 
the audience to understand and interpret what 
they had seen. Hence, the Ss were told they 
would see a very brief scene and would then be 
asked to make certain judgment about it. They 
were urged to guess when they could not be 
sure of their answers. 


Following the instructions, the practice 
scene was shown. The Ss then had 3 minutes to 
answer 20 questions written by E so as to 
be relatively easy to answer in order to en- 
courage Ss to think that the task was not 
really difficult. The same scene was then shown 
again and the Ss given a short period to com- 
plete answering the questions. The Ss did not 
know that this was a practice exercise. Follow- 
ing this the experimental film was shown, Ss 
were given 3 minutes to answer the 26 selected 
items, the same film was shown again, and Ss 
were given another brief period to complete 
answering the questions for that film. After 
the test papers were collected, it was explained 
that E was interested in relating their judg- 
ments of the film characters to certain aspects 
of personality and that, therefore, they were 
being asked to complete a personality inven- 
tory. The Ss were permitted to work at their 
own speed and leave when they had finished. 


Results 
The experiment has the form of a 5 X 5 X 2 
factorial design. There were five scenes, each 


Table 1 


Analysis of Variance of Projection Scores 











Source of variation df Meansquare F 
Between versions + 57.3705 1.34 
Between scenes 4 341.3176 7.98** 
Between sexes 1 2.7880 — 
Version X scene 16 54.1073 1.65 
Version X sex + 25.7330 - 
Scene X sex 4 54.7306 1.67 
Version X scene X sex16 32.7392 1.77* 
Within groups 375 18.5386 
Total 424 





* Indicates significance at 5% level. 
** Indicates significance at 1% level. 
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varying five ways (versions) with the Ss 
grouped by sex. Analysis of variance was the 
principal statistical technique. The data were 
tested, and it was shown that the conditions of 
normally distributed scores and homogeneity 
of variance, necessary in the analysis of var- 
lance, were met. 

The analysis of variance is summarized in 
Table 1. 

It will be seen in Table 1 that the differ- 
ences between the means of the scenes were 
highly significant. It was therefore appropriate 
to determine the nature and extent of these dif- 
ferences by means of ¢ tests. These results are 
summarized in Table 2. 











Table 2 
Differences between Means of Scenes 
of of 

Mean Scene Mean Scene Difference 
12.86 1 11.78 2 1.08 
12.86 1 10.93 3 1.93** 
12.86 1 16.19 + —3.33** 
12.86 1 13.31 5 — 45 
11.78 2 10.93 3 85 
11.78 2 16.19 os —4.41** 
11.78 2 13.31 5 —1.53* 
10.93 3 16.19 4 —5.26** 
10.93 3 13.31 5 —2.38** 
16.19 + 13.31 5 2.88** 





* Indicates significance at 5% level. 
** Indicates significance at the 1% level. 


It will be seen in Table 2 that the mean 
projection score for Scene 4 (old man) was 
significantly greater than any other scene, and 
the mean score for Scene 5 (old woman) was 
significantly greater than the mean of Scenes 
2 and 3. 

Because of the nature of the measure of pro- 
jection the need for additional analysis was in- 
dicated. Since an individual’s projection score 
was the sum of the times he answered an item 
the same way on each of two tests, merely by 
chance an § might be said to be “projecting” 
with respect to a particular item 50 per cent 
of the time and thus might be expected to get a 
“projection” score of 13 (26/2) by chance a- 
lone. ‘The mean projection score over all Ss was 
13.01 Because the obtained and chance mean 
scores were virtually identical, chi-square val- 
ues were computed for the agreement between 
answers to each item in both tests. The fre- 
quency of obtained chi squares for each of the 
26 items was compared to the chance distribu- 
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tion of chi square. The resulting chi-square 
value yielded a p of approximately .15. Hence, 
the observed distribution of chi square for the 
26 items did not differ significantly from the 
distribution that wouid be expected to arise if 
only chance were operating. 


The implications of these findings in terms 
of the specific hypotheses are discussed below. 

1. Hypothesis 1 predicted that Ss would pro- 
ject their own characteristics onto an ambig- 
uous film protagonist. The last finding report- 
ed, i.e., that the frequency of agreement be- 
tween the same items on the two tests (which 
was the measure of projection) did not differ 
significantly, seems to indicate, if considered 
alone, that projection as defined and measured 
in this experiment did not occur. On the other 
hand, the F ratio for differences between 
scenes was significant well beyond the 1 per 
cent level. 


It could be true, of course, that the present 
experiment was the “‘less-than-one-time-out-of- 
a-hundred” in which the differences occurred by 
chance. By definition, this event is unlikely. 
A more likely interpretation of this apparent 
contradiction is that no measurable degree of 
projection occurred with respect to Scenes 1, 
2, and 3 but that Ss did project their own 
characteristics onto the protagonists of Scene 
4 and, possibly, Scene 5. However, while there 
was sufficient nonchance agreement between 
the film test and MMPI items to raise the 
mean projection score on Scene 4 significantly 
above all other scenes, and on Scene 5 above all 
but one other scene, these nonchance agree- 
ments, when grouped with the apparently 
chance scores of the other scenes, were insuf- 
ficient to produce chi-square values which dif- 
fered significantly from chance. 


It, therefore, can be said that Ss were found 
to project onto some ambiguous film protag- 
onists, but the result did not indicate that 
the phenomenon was general. 


2. Hypothesis 2 predicted that projection 
would increase with the iconicity of the protag- 
onist. The iconicity variable was embodied in 
the versions. The between-versions F of 1.34 
in Table 1 indicated that no significant dif- 
ferences between the means of versions were 
found. In view of the fact that the scores of at 
least three of the five scenes did not differ 


significantly from chance, it was to be expected 
that the versions would not differ. When 
Scenes 4 and 5, in which there appears to have 
been projection not attributable to chance, 
were analyzed apart from the other scenes, no 
significant differences between the means of 
the versions of those scenes were found. Hy- 
pothesis 2 was not confirmed. 

3. The third hypothesis predicted that Ss 
would project more onto protagonists of the 
same sex than onto protagonists of the opposite 
sex. In Table 1, it will be seen that the scene 
X sex interaction term was not significant. In 
fact, both men and women projected most on- 
to the protagonist of Scene 4, an old man. 
Hence, this hypothesis was not confirmed. 

4. Hypothesis 4 predicted that S- would pro- 
ject most onto protagonists of the sime appar- 
ent age as themselves. Hence the greatest pro- 
jection should have occurred onto Scene 2 
(young man) and Scene 3 ( young woman). 
It will be seen in Table 2 that these two 
scenes were the least effective in eliciting pro- 
jection. The most effective scenes were 4 and 
5 in which the protagonists were an old man 
and old woman respectively. Hypothesis 4 was 
not confirmed. 

Discussion 

This study was undertaken primarily to ob- 
tain information about the use of motion pic- 
tures for projective testing. While the results 
do not permit valid conclusions to be drawn 
about the relative effectiveness of films per se, 
some subjective impressions of the experimen- 
ter might appropriately be discussed here. 

One of the severest handicaps that a film 
suffers, when used as in this experiment, lies 
in the short time which may be given to § to 
view the stimulus scene. (In this instance, two 
showings of 35 seconds each.) In the conven- 
tional ‘TAT administration, § may take vir- 
tually as much time as he wishes for looking at 
the card. Furthermore, he has the card before 
him while he is telling his story. It may well 
be that this makes an important contribution 
to the value of a still picture for eliciting pro- 
jection because, with an essentially unlimited 
time to study the picture, § is provided with 
an always present source of material from 
which to elaborate his fantasies. 

It is rather difficult to provide as much time 
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in a motion picture as an § might effectively 
use, while retaining the necessary element of 
amb:guity and adding the presumably impor- 
tant' element of realism. A motion picture is 
real’:tic partly because it depicts people be- 
hav&g—acting and interacting. Normally, the 
mot a person is shown behaving, the more 
the Zsituation is defined, i.e., it loses am- 
big2'ty. While motion pictures can be produced 
sho#ing people behaving without defining the 
iste it is not certain, since it is not one’s 
usi®1 experience with motion pictures or with 
lif¢:; that such a procedure does not detract 
fre“ the realism of the scene. A film loop de- 
vict which would permit the repeated showing 
of ‘1 single short sequence could be used but, 
ag” in, it is not certain that this would not im- 
pa‘r the realism of the scene inasmuch as people 
nv“mally do not repeat an identical action 
over and over. The same difficulty applies to 
scund, for it would seem that an ambiguous 
sound heard repeatedly either ceases to be am- 
b:guous, or convinces the subject that it was 
not intended to be interpretable. 


These considerations are subjective and 
should not preclude further research in the 
area. They do, however, indicate some of the 
problems which must be met if a motion pic- 
ture test similar to the TAT is to be developed. 


Conclusions 
1. The perception of an ambiguous protag- 
onist as being like oneself does not appear to be 
as generalized a phenomenon as some of the 
TAT literature would indicate. Such projec- 
tion was found to occur but to a very limited 
extent. 


2. The experiment did not yield empirical 
evidence to determine the probable effective- 
ness of motion pictures as a medium for pro- 
jective personality testing. That is, projection 
was not found to vary with the iconicity of the 
stimuli. There is subjective evidence, however, 
to suggest that a film test following the TAT 
paradigm may not be the most effective use of 
the motion picture medium for this purpose. 

3. With respect to sex and age, this study 
did not support the hypothesis that Ss will 
project more onto protagonists who are 
physically similar to themselves. Indeed, this 
study seemed to support the conclusion that 
such similarity may actually discourage pro- 
jection. 


Charles J. 


McIntyre 


Summary 


A study was undertaken to investigate the 
probable effectiveness of sound motion pictures 
as a medium for projective personality testing, 
and to attempt to define some of the character- 
istics which should be built into such a test. 

Short motion pictures, based upon five TAT 
cards whose central figures differed by sex and 
age, were produced in such a way as to incor- 
porate varying degrees of realism. 


The projection associated with each of the 
three variables was measured and compared. 
Projection was operationally defined as the ex- 
tent to which a subject’s perception of himself 
agreed with his perception of the protagonist. 


Little projection was found to occur. The 
projection that did occur was associated with 
the two parental-figure protagonists. No dif- 
ferences in projection associated with the real- 
ism variable were found. 


Received December 11, 1953. 
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A_Note on the Use of a Paper-and-Pencil Form of 
the MMPI:Hs Scale for; Hospital Use *”* 


Sol Charen 


Catholic University of America 


‘The use of a single scale of the MMPI, ac- 
cording to Machover and Anderson [1], is 
often desirable in clinical practice. This is es- 
pecially true in hospital clinics and outpatient 
departments where some method of screening 
patients with neurotic symptoms from those 
with organic problems is needed. 


The 33 items of the Hs scale of the MMPI 
were mimeographed on a single sheet in the 
same sequence in which they appear in the 
group form booklet of the MMPI. Subjects 
were 50 hospitalized tuberculosis patients 
shortly to be discharged as arrested cases. 
Their median age was 35 years with the age 
range from 21 to 69 years. 

The method of testing was identical to that 


1From the Veterans Administration Hospital, Bal- 
timore, Maryland. The statements and conclusions 
reached in this article are those of the author and 
do not necessarily reflect the opinion or policy of 
the Veterans Administration. 


2The author wishes to thank Dr. Ross McLean, 
Chief of Medicine, VA Hospital, Baltimore, Mary- 
land for his help in making available the patients 
used in this research. 


8An extended report of this study may be ob- 
tained without charge from Sol Charen, 200 Rhode 
Island Avenue, N. E., Washington 2, D. C. or for 
a fee from the American Documentation Institute. 
To obtain it from the latter source order Document 
No. 4320 from ADI Auxiliary Publications Project, 
Photoduplication Service, Library of Congress, 
Washington 25, D.C., remitting in advance $1.25 
for microfilm or $1.25 for photocopies. Make checks 
payable to Chief, Photoduplication Service, Library 
of Congress. 


used by Machover and Anderson except that 
the time interval between test and retest was 
one week. The group-form booklet of the 
MMPI was used and testing was done in 
groups. Half the patients were given the paper- 
and-pencil form of the Hs scale and a week 
later were retested with the booklet. The other 
25 were tested in reverse order. . 

The mean T' score of the 50 subjects on the 
experimental form was 56.14 against a mean of 
57.87 for the group booklet form of the scale 
with p equal to .73 for a two-tailed test. Mean 
T scores for all methods of testing ranged 
from 55.20 to 59.80. The Pearson product- 
moment correlation between group booklet 
form of the Hs scale and the paper-and-pencil 
form was .980. 


The paper-and-pencil form of the Hs scale 
of the MMPI gave almost identical T scores 
as a retest with the group booklet form. The 
correlation between the two was .980. The 
paper-and-pencil form of the Hs scale seems, 
then, worth while for use in hospital clinics and 
outpatient departments where quick testing 
and screening of patients is desirable. 


Brief Report 
Received June 16, 1954. 
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Transcendence Indices, Extent of Personality 
Factors in Fantasy Responses, and the Ambiguity 
of TAT Cards’ 


Douglas T. Kenny 


University of British Columbia 


This paper is the third in a series concerned 
with testing the widely accepted assumption 
of a monotonic relationship between stimulus 
ambiguity and extent of personality factors in 
the evoked fantasy. Any study exploring this 
relationship must concern itself with two pri- 
mary methodological considerations, namely, 
the specifications of the meanings assigned to 
the concepts of both stimulus ambiguity and 
personality content and the way in which 
these terms are to be measured. 

Weisskopf [6, 7] has presented evidence 
showing that pictures with low physical am- 
biguity elicit less projection than more highly 
structured ones. Physical “impoverishment” 
of the stimulus, by incomplete line tracings 
and varying exposure time, was used as an in- 
dicator of stimulus ambiguity. Projection was 
defined in terms of a transcendence index 
which is based on the mean number of re- 
sponses “which go beyond pure description.” 
In an earlier paper it was pointed out by 
Bijou and Kenny that such findings “ .. . 
may be used to evaluate the proposition under 
consideration provided one assumes that (a) 
stimulus ambiguity is properly defined in 
terms of physical properties and, (4) there 
is a direct relationship between amount of fan- 
tasy and amount of personality factors intro- 
duced” [1, p. 204]. 

Employing a different set of measurement 
operations, Kenny and Bijou [2] found that 
with increasing psychological ambiguity there 
is an initial increase in the extent of person- 
ality factors revealed and then a decrease. In 


1The author wishes to express his appreciation to 
Dr. Edith A. Weisskopf-Joelson for providing him 
with a transcendence index scoring manual. He is 
indebted to Professor E. S. W. Belyea for photo- 
graphing and making the projector slides of the 
TAT pictures. 
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contrast to Weisskopf’s procedure, ambiguity 
was defined in terms of psychological rather 
than physical properties. Ambiguity was de- 
fined in terms of the estimated number of in- 
terpretations that judges thought would apply 
to each TAT picture. In analyzing the sig- 
nificance of personality factors based on TAT 
stories, Stephenson’s [4] Q-array technique 
was utilized rather than unidimensional scales 
or transcendence indices. 

It seems pertinent to relate these two differ- 
ent approaches that have been used in testing 
the monotonic relationship postulated between 
stimulus ambiguity and extent of personality 
factors revealed in fantasy responses. ‘The 
present research aimed at investigating the re- 
lationship between projection, as defined by 
transcendence indices, and extent of personality 
factors revealed to TAT pictures, as deter- 
mined by a Q-array technique. It seems worth 
while to test Weisskopf’s assumption that there 
is a direct relationship between her transcend- 
ence indices and the extent of personality fac- 
tors introduced into IAT protocols. As yet, 
there is no empirical evidence to indicate that 
transcendence indices can be used as indicators 
of the amount of clinically interpretable ma- 
terial elicited by a picture. In addition, an at- 
tempt was made to see how transcendence in- 
dices varied as a function of physical ambiguity, 
psychological ambiguity, and stimulus ambig- 
uity involving a combination of both. physical 
and psychological properties. 


Method 


Ascertaining Stimulus Ambiguity 
The three procedures for determining stim- 
ulus ambiguity were: 


Psychological ambiguity. From the first study [1], 
15 TAT cards varying in three degrees of psycho- 
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logical ambiguity were obtained. A group of 51 
judges ranked 21 TAT cards in terms of the esti- 
mated number of interpretations each card possessed. 
By this procedure three sets of five cards, varying 
in three degrees of increasing psychological ambig- 
uity, were selected. Cards 5, 15, 18BM, 11, and 19 
were classified as the most ambiguous sets. Cards 4, 
7BM, 8BM, 12M, and 13MF made up the inter- 
mediate group. Cards 12BG, 1, 2, 9BM, and 17BM 
comprised the least ambiguous set. 

Physical ambiguity. In order to induce physical 
ambiguity, changes in the exposure time of the TAT 
cards were used. For the present study, the 15 TAT 
cards were photographed with approximately the 
same intensity as the standard set. The cards, on 
individual slides, were projected onto a screen, and 
the subjects were simply asked to describe the pro- 
jected picture. The pictures were shown to 80 sub- 
jects, using three to eight subjects at one time. 
All subjects were drawn from introductory psy- 
chology classes at the University of British Colum- 
bia. Forty male subjects described the pictures under 
a 5-second exposure time (high physical ambiguity), 
and another 40 male subjects described the pictures 
under a 2-minute exposure time (low physical am- 
biguity). 

Combined physical and psychological ambiguity. 
The 15 TAT cards were classified in terms of both 
physical and psychological dimensions of ambiguity 
by making use of Murray’s placement of the cards. 
It will be recalled that Murray divided the cards 
into two groups of ten, cards numbered 10 and be- 
low being more structured than those numbered 11 
and above. Murray’s placement of the cards was 
based on the physical characteristics of the cards 
as well as on diagnostic value. Of the 15 TAT 
cards, seven are from Murray’s first 10 and eight 
are from his second ten. 


Measurement of Personality Factors 


As indicated, the aim of this research was to 
determine the relationship between two meas- 
ures of fantasy responses to TAT pictures, a 
Q-array technique and transcendence indices. 
Transcendence indices for each of the 15 TAT 
cards were obtained by scoring the descriptions 
that the subjects gave to the cards under the 
two exposure times. Weisskopf’s manual on the 
scoring for transcendence indices was em- 
ployed. Separate transcendence indices were 
worked out for the different exposure times. 
For a detailed description of the Q-array scor- 
ing method and the administration method of 
the TAT pictures, the reader is referred to the 
second paper in this series [2]. Suffice it to say 
here that the 15 TAT cards were administered 
individually to 18 male college students. Two 
well-trained clinical psychologists, utilizing 
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the Q-array method, judged the significance of 
the personality factors “injected” into the 
TAT stories. The correlation of the scores be- 
tween the two clinicians was satisfactory (r = 
.68). 

Results 

‘The most important question likely to arise 
is: What, if any, is the relationship between 
the ranking of the TAT cards for revealingness 
of the personality as determined by the Q-array 
method and the ranking of the same cards in 
terms of transcendence indices ? The rank-order 
correlations between personality revealingness 
and the transcendence indices were .62 and .64 
for the 5-second and the 2-minute exposure 
groups respectively. Statistical significance is be- 
yond the .01 level for the p of .64 and at the .05 
level for the p of .62. The data clearly support 
Weisskopf’s contention that transcendence in- 
dices are related to personality revealingness in 
TAT pictures. 

A second question asked is: To what extent 
does the transcendence index vary as a function 
of the physical ambiguity of the stimulus? 
Table 1 presents this finding in terms of the 


Table 1 


Analysis of Variance of Transcendence Indices 


df Mean F 








Source of variation 





square 
Between exposure times 1 1643.26 44.94** 
Subjects in same group 78 36.56 
Total between subjects 79 
Psychological ambiguity level 2 73.86 18.37** 
Ambiguity X exposure time 2 17.58  4.37* 
Pooled subjects X ambiguity 156 4.02 
Total within subjects 160 
Total 239 





. Significant at 5 per cent level, 
** Significant at 1 per cent level. 


difference between exposure times. The data 
confirm Weisskopf’s findings in showing that 
subjects reliably increase their transcendence 
indices under long exposure times. 

A third question asked is: Do transcendence 
indices vary with degree of psychological am- 
biguity when the transcendence scores are clas- 
sified under three sets of pictures varying in 
three degrees of increasing psychological am- 
biguity? The F for Between Psychological 
Ambiguity Level, as shown in Table 1, indi- 
cates significant differences between the three 
levels of psychological ambiguity. To deter- 
mine which sets of cards show the differences, 
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t tests were made between the sets using the 
interaction of pooled subjects X ambiguities 
as the error estimate. This analysis showed that 
the intermediate ambiguity set had significantly 
higher transcendence indices than either the 
most or least ambiguous sets. The differences 
were significant at the 1 per cent level of con- 
fidence. There were, however, no differences in 
transcendence indices between the most ambig- 
uous and least ambiguous cards. This finding, 
combined with the previous finding [2] that 
the cards in the median ambiguous set reveal 
significantly greater personality factors than 
those in the least and most ambiguous sets, 
shows that those cards which have higher trans- 
cendence indices are also the cards which re- 
veal the most about personality. 


Data in Table 1 also show a significant in- 
teraction between length of exposure time and 
psychological ambiguity level. Examination of 
the differences involved in this interaction 
shows that the intermediate ambiguous set 
yielded higher transcendence indices than the 
most ambiguous set under long exposure time, 
but not under short exposure time; also, the 
intermediate set showed significantly higher 
transcendence indices than the least ambiguous 
set, under either short or long exposure time. 


The final question asked is: Are there higher 
transcendence indices for the TAT cards from 
the last ten than from the first ten? Analysis 
of variance results showed that there were no 
differences in the transcendence indices be- 
tween these sets of cards. Hence, Murray’s 
hypothesis of a difference in degree of projec- 
tion between these two sets of cards is not sup- 
ported by the data. The interaction between 
this twofold classification of ambiguity and 
time of exposure was not significant. 


Discussion 


Two of the most interesting findings which 
emerge from this study are that the extent of 
personality material revealed in a picture is 
correlated with the transcendence index of 
the picture and that cards from the inter- 
mediate psychologically ambiguous set yield 
higher transcendence indices than either the 
least or most ambiguous sets. The former 
finding supports Weisskopf’s assumption of a 
direct relationship between amount of trans- 
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cendence and amount of personality factors. 
The latter result may be accounted for in 
terms of three possible factors which are de 
scribed in greater detail elsewhere [2]. Briefly, 
transcendence indices may not have increased 
with increasing psychological ambiguity be- 
cause (a) anxiety, which may mount with in- 
creases in ambiguity, inhibited greater projec- 
tions; (+) the cue patterns in the three sets of 
cards do not vary as assumed; or (c) there may 
have been qualitative differences among the 
three sets of cards. Any three of these plausible 
explanations may account for the obtained re- 
sults. 

The results of the present study, as well as 
Weisskopf’s research, do not conform to the 
theoretical expectation that increases in physi- 
cal ambiguity should be accompanied by in- 
creases in transcendence indices. In terms of 
the previous formulation of this problem [2], 
it may be hypothesized that a decreasing num- 
ber of cue constellations available for selective 
reactions produces response tendencies which 
do not contain much in the way of individual 
projections. 

Contrary toMurray’s hypothesis, cards from 
his more structured series did not yield higher 
transcendence indices than cards from the less 
structured series. This finding substantiates the 
previous conclusion [2] that Murray’s most 
ambiguous set does not elicit more significant 
personality factors than his least ambiguous 
set. On the other hand, Weisskopf [5] found 
that the well-structured series actually elicited 
higher transcendence indices than the least 
structured series. This discrepant finding be- 
tween the two studies may be explained in 
terms of the differences in the TAT cards 
used in the two studies. 


Summary 


This paper describes an experiment relating 
the concepts of transcendence and extent of 
personality factors in elicited fantasy. The re- 
sults are consistent with Weisskopf’s assump- 
tion that the extent of personality material re- 
vealed in a TAT picture is correlated with the 
transcendence index of the picture. In addi- 
tion, it was shown that with increasing psy- 
chological ambiguity there is an initial increase 
in transcendence and then a decrease. The the- 
oretical expectation that transcendence indices 
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should increase with increases in physical am- 
biguity was not substantiated. Finally, the ex- 
pectation that TAT cards from Murray's 
second series should elicit higher transcendence 
indices than cards from his first series was not 
upheld. 
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A Psychotherapy Case Showing Progress but No 
Decrease in the Discomfort-Relief Quotient 


Edward J. Murray, Frank Auld, Jr., and Alice M. White’ 


Yale University 


The purpose of this paper is to demonstrate 
that a case may show progress even though 
there is no drop in verbal tension. Verbal ten- 
sion was measured by the Discomfort-Relief 
Quotient (DRQ), an objective method of de- 
termining the tension expressed in the sentences 
of a patient during psychotherapy interviews. 
The DRQ was developed by Dollard and 
Mowrer [4] to measure tension during social 
casework interviews. Mowrer [12, 13] and 
Kauffman and Raimy [10] have gone further 
with it and have concluded that a tension drop 
during psychotherapy, as measured by the 
DRQ, indicates therapeutic progress. 

The DRQ was compared with a content- 
analysis procedure which shows changes that 
can be interpreted as indicating progress. ‘The 
method of content analysis was developed by 
the senior author [14] on the basis of concepts 
of motivation and conflict derived from learn- 
ing theory and psychoanalytic theory. 


The DRQ and the content analysis were 
applied to the case of Mrs. B., a psychotherapy 
case which has received a detailed clinical study 
by Dollard, Auld, and White [2]. The exist- 
ence of this qualitative study of the case will 
enable the interested reader to evaluate better 
the clinical significance of the quantitative re- 
sults presented here. 


The DRQ Study of the Case 


The procedure for scoring the DRQ has 
been described in detail by Dollard and Mow- 
rer [4]. Briefly, each unit is judged as indicat- 
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ing discomfort (drive, want, tension, pain, 
suffering), relief (drive reduction, reward, 
pleasure, relaxation), or neither. The DRQ is 
the number of discomfort units, divided by the 
number of discomfort units plus relief units. 
The resulting quotient is multiplied by 100 to 
provide a scale ranging from 0 (no tension) 
to 100 (all tension). 

In applying the DRQ to the case of Mrs. 
B., two graduate students independently 
scored summaries of all 17 therapy hours. 
These students were psychologically sophisti- 
cated but unfamiliar with the case. They scored 
the summaries in a random order so that they 
would not be influenced in their scoring by the 
“plot” of the case or by preconceptions about 
the direction of tension change. Their agree- 
ment was high (r = +.92, df = 15, p< .01). 
Figure 1 shows the average DRQ of the two 
scorers for each of the therapy hours. It can be 
seen that, although there is some fluctuation 
in the DRQ from hour to hour, there is no 
consistent trend throughout the course of thera- 
py. There is neither a gradual decline in ver- 
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Fig. 1. The Discomfort-Relief Quotient based on 
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bal tension nor a sudden drop near the end of 
treatment. 

It is possible that the DRQ showed no de- 
cline because the summaries did not truly re- 
flect tension expressed in the patient’s sentences. 
In order to explore this possibility, two other 
psychologically sophisticated people applied the 
DRQ to the verbatim typescripts of six of the 
interviews. These scorers were given the pages 
of the six interviews in random order. The in- 
terviews were selected for typing in the fol- 
lowing way: five successive blocks of three or 
four hours were delineated and one hour was 
welected randomly from each block. Hour 11 
was added because it had been previously typed 
ror the Dollard, Auld, and White book. ‘The 
agreement of the two scorers was high (r = 
-.96, df = 4, p < .01). The averaged results 
xre shown in Figure 2. Again, no trend is ap- 
"arent. 








100- 
+ 

z 

ws 

= 804 —_—_.. a 
°o 

> 

So 

u 604 
3 

os) 

« 

AJ 

« 40- 
°o 

i 

= 

S 

” 20- 
fo) 

® 2 6 8 i 13 15 


PSYCHOTHERAPY HOURS 


Fig. 2. The Discomfort-Relief Quotient based on 
verbatim typescripts of six randomly selected ther- 
apy hours with Mrs. B. 


The Content Analysis 


Murray has described his content-analysis 
method in more detail elsewhere [14]. Scorers 
in this study put each of the patient’s state- 
ments into one of several categories. The re- 
sults are reported for four major categories: 
(a) hostility toward mother and children, (4) 
general hostility toward husband, (c) sex con- 
flict related to husband, and (d) general anxi- 
ety related to no one in particular. These cate- 
gories include both approach and avoidance 
tendencies in each area. Thus, hostility includes 
both expression of hostility and expression of 
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anxiety or guilt about hostility. The sex conflict 
with the husband includes sexual desire, sexual 
anxiety, and hostility specifically related to 
sexual frustration. 

The main judge in this study scored the 
typescripts of six therapy hours in a random 
order. A psychologically naive scorer was used 
to check reliability. This person scored two 
hours with the main judge for training pur- 
poses and then scored the remaining four hours 
independently. Agreement between the two 
scorers for the four hours was high: for hos- 
tility to mother and children, r = +.997, df 
= 2, p < .01; for general hostility to husband, 
r = +.995, df = 2, p < .01; for sex conflict 
with husband, r= + .993, df = 2, p < .01; 
and for general anxiety, r — + .956, df = 2, 
p < .05. In order to control for differences in 
the total number of statements from hour to 
hour, the raw frequency scores were converted 
into percentages of the total number of state- 
ments in the hour. 

The sum of all four categories reveals no 
striking change throughout therapy, as shown 
in Figure 3. Whatever slight trend exists can 
be accounted for almost entirely by the high 
point on Hour 6. Although the precise shape of 
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Fig. 3. Conflict statements of four major cate- 
gories in six randomly selected therapy hours with 
Mrs. B. 


this curve differs from the DRQ curve in 
Figure 2, the over-all impression is the same. 


The content analysis shows important 
changes in the patient’s speech when the sepa- 
rate areas of conflict are considered. During 
the course of therapy, the patient shifted from 
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talking about her conflict with her mother and 
children to talking about her conflicts with her 
husband. This is shown in Figure 4, where 
“hostility conflict related to mother and chil- 
dren” and the sum of the conflict categories 
relating to the husband (i.e., both general hos- 
tility and sex) are plotted. 

The nature of the conflicts about the hus- 
band also changed during therapy. Figure 5 
shows the category of general hostility to the 
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Fig. 4. Conflict statements about mother and chil- 
dren, and conflict statements about husband, in six 
randomly selected therapy hours with Mrs. B. 


husband and the category of sex conflict with 
the husband. The general hostility conflict was 
replaced by the sex conflict during the course 
of therapy. The general hostility conflict con- 
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Fig. 5. General hostility conflict statements about 
husband, and sex conflict statements about husband, 
in six randomly selected therapy hours with Mrs. B. 
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sisted of criticisms of the husband’s attitudes 
toward social life, vacations, etc., and some 
guilt about these criticisms. The sex conflict 
included statements about the patient’s own 
frustration, statements blaming her husband, 
and eventually statements showing some in- 
sight into her own inhibitions. 


The content analysis, then, shows a change 
during the course of therapy from talking 
about a hostility conflict about the patient’s 
mother and children to talking about a hos- 
tility conflict about unimportant matters con- 
cerning her husband and, finally, to talking 
about a fundamental sexual conflict about her 


husband. 


Discussion 


According to Dollard, Auld, and White 
[2], Mrs. B. made some progress in therapy, 
although her case was not a “finished” one. 
Their account of the case is briefly as follows: 

Mrs. B. 


story.” 


began therapy with a defensive “cover 
She complained that her mother had stolen 
away her children and that she (the patient 
unable to stand up tor her rights in the situation 
According to Dollard, Auld, and White, this baby- 
snatching was not a primary prob!em; indeed, Mrs. 
B. had very little trouble asserting herself toward 
her mother or anyone else. The therapist refused to 
accept the cover story as an adequate explanation. 
He also insisted that she could not avoid discussing 
her marital life. Mrs. B. began to complain about 
her husband. At first she complained about unim 
portant matters such as his lack of interest in parties 
The therapist found it difficult to believe that these 
things had the overwhelming importance ascribed to 
them. He noted that the patient had said nothing at 
all about her sex life. Mrs. B. gradually began to 
talk about her sex life. She said at first that it was 
satisfactory; she failed to see any connection be- 
tween sex and her presenting symptoms of depres- 
sion. But as she followed the rule of free association 
she began talking about her sexual frustration and 
her husband’s inadequacy. Later she saw the role 
her own inhibitions played in the situation. She final- 
ly realized that her sexual feelings toward her 
father had been transferred to her husband along 
with her horror of committing incest. She had un- 
consciously rejected her marriage and her responsi- 
bilities to her children as well. Toward the end 
of therapy the patient reported that her husband 
had spontaneously commented that she “seemed 
much better in bed—more interested now.” Un- 
doubtedly Mrs. B. had not solved all of her prob- 
lems, but she had gained some insight. 


was 


The results of the independent content anal- 
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ysis are in remarkable agreement with the 
qualitative analysis. The content analysis shows 
a decrease in the category of “hostility conflict 
about mother and children,’ which corre- 
sponds to what Dollard, Auld, and White call 
the “cover story.” The content analysis also 
shows the shift in verbalizations first to a gen- 
eral hostility conflict about the husband and 
then to a sexual conflict about the husband. 
The advantage of the content analysis is that 
it describes precisely and quantitatively thera- 
peutic events which the qualitative analysis 
describes in an impressionistic way. Moreover, 
the content analysis has been demonstrated to 
be reliable. The agreement between the content 
analysis and the qualitative analysis shows that 
the content analysis measures meaningful and 
theoretically relevant things. 


The DRQ did not show the decrease which 
is said to accompany progress. Several other in- 
vestigations have also found no relationship 
between the DRQ and therapeutic progress. 
Hunt [7, 8] and Hunt and Kogan [9] found 
a correlation of only .20 between DRQ decre- 
ment and caseworkers’ ratings of movement. 
The failure of the DRQ to drop in the present 
case was due to the fact that the patient verbal- 
ly expressed tension about something or other 
throughout therapy. The progress in the case 
was due to an increase in insight which occurred 
when the verbalizations shifted toward a basic 
conflict. The patient learned something new 
about herself which apparently affected her 
behavior outside of therapy. 


An important problem is the relationship of 
the DRQ to the tension actually experienced 
by the patient. Tension may have remained at 
the same level throughout therapy with the 
patient gradually becoming aware of its origin 
in her sexual conflict. In this case the DRQ 
would have accurately reflected the tension ex- 
perienced by the patient. However, there is 
reason to doubt such an accurate reflection 
since the DRQ does not correlate very highly 
with physiological measures of tension [13]. It 
is much more likely that Mrs. B. experienced 
more tension as she began discussing her sex- 
ual conflicts than she had while elaborating her 
cover story. In this connection, it is perhaps 
significant that the final content category of 
general, or free-floating, anxiety consistently 
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increased during therapy. 

There are many examples in the literature 
of the need to increase tension in order to get 
‘therapeutic results. Freud [6] found it was 
necessary to break through Ja belle indifférence 
of the hysteric to achieve therapeutic results. 
The isolation of emotion from thought in the 
obsessive-compulsive has proved a stumbling 
block in therapy; it is only when such a patient 
feels tense that progress is made [5]. Alex- 
ander and French [1] have cited many cases 
in which the frequency of contacts was purpose- 
ly manipulated to increase tension. The au- 
thors believe that “. . . every analysis should be 
conducted on as high an emotional level as the 
patient’s ego can stand without diminishing its 
capacity for insight” [1, p. 30]. Miller’s the- 
ory of conflict [11] provides a rationale for 
these empirical findings. According to this 
theory, when a therapeutic tactic enables a 
patient to approach closer to a feared goal, the 
absolute level of fear is increased. The result 
has been called the negative therapeutic effect 
[3], since the increased fear often brings about 
a return of symptoms. Therefore, although we 
would expect an eventual reduction of tension 
in a successful patient’s everyday life, we would 
not necessarily expect a reduction of tension in 
the therapeutic situation, particularly in short- 
term therapy. 

The foregoing analysis raises the problem of 
why the patient stays in therapy in the face of 
increasing tension. The answer is partly that 
many patients leave therapy when anxiety in- 
creases. In successful cases, the tendency to 
leave seems to be counterbalanced by several 
little understood factors. First, there are many 
rewarding features of the transference relation- 
ship [3]. Second, the symptoms and frustrated 
drives which originally motivated the patient 
to seek help continue to operate. Third, the 
solution of minor problems eases the tension 
in the patient’s daily life to some extent and 
reinforces hope of solving the more important 
problems. 


Summary and Conclusions 


1. The purpose of this study was to show 
that a psychotherapy case in which there was 
no drop in verbal tension might show progress 
in other ways. The Discomfort-Relief Quo- 
tient was used as a measure of verbal tension, 
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and a content analysis in terms of motivation 
and conflict was used to show other verbal 
changes. 

2. Two separate applications of the DRQ 
to the case of Mrs. B. showed no change in 
verbal tension during therapy. Each application 
was demonstrated to be reliable. 


3. The content analysis showed that during 
therapy the patient progressed from a discus- 
sion of a “cover story” about a hostility con- 
flict with her mother to a discussion of con- 
flicts related to her husband. Furthermore, she 
progressed from discussing a general hostility 
conflict about relatively unimportant matters 
in relation to her husband to discussing much 
more fundamental sexual conflicts. The content 
analysis was shown to be reliable. 


4. The results of the content analysis were 
shown to be consistent with an independent, 
qualitative clinical analysis. 

5. It was pointed out that the DRQ may 
not reflect the tension experienced by a patient. 
It was also pointed out that although an even- 
tual tension reduction in a successful patient’s 
everyday life would be expected, a reduction 
of tension in the therapeutic situation would 
not necessarily be expected. 

6. We conclude that although the DRQ may 
be a good measure of the tension expressed in 
a patient’s sentences, a study of this one case 
provides no support for the view that the DRQ 
is useful for assessing therapeutic progress. In 
this case, other measures of the content of the 
patient’s speech proved more illuminating than 


the DRQ. 
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The Effect of Childhood Diseases 
on IQ Variability ’ 


Lillian Wagenheim 
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Two previous studies by the writer showed 
a relationship between the early contraction of 
measles, chicken pox, mumps, and German 
measles and later school achievement. ‘This re- 
lationship was found among boys who had con- 
tracted these diseases under age three and most 
significantly in those at age two. 


In:the present study, the records of 493 boys 
werefused. The data obtained included IQ’s, 
achievement grade level in reading and arith- 
metic, and the ages of contraction of the fol- 
lowing childhood diseases: measles, chicken 
pox, German measles, mumps, whooping cough, 
diphtheria, scarlet fever, tonsillitis, pneumonia. 

Cases were considered variable if two IQ 
scores resulting from tests administered during 
different years showed a difference of 10 or 
more points. 


The contraction of whooping cough, tonsil- 
litis, chicken pox, and measles under age five 
was related at the 1% or 3% level to the vari- 
ability in IQ. The contraction of mumps, Ger- 
man measles, and pneumonia under age five 
did not show a significant relationship to IQ 
variability. 

In order to discover the effect of childhood 
diseases in general on IQ variability, the cases 
were regrouped for the earliest contraction of 
any disease. 


Boys who had contracted any disease under 
age five were more frequently found in the 


1An extended report of this study may be ob- 
tained without charge from Lillian Wagenheim, 
University of Southern California, Los Angeles 7, 
California or for a fee from the American Documen- 
tation Institute. To obtain it from the latter source, 
order Document No. 4319 from ADI Auxiliary Publi- 
cations Project, Photoduplication Service, Library of 
Congress, Washington 25, D.C., remitting in ad- 
vance $1.75 for microfilm or $2.50 for photocopies. 
Make checks payable to Chief, Photoduplication 
Service, Library of Congress. 


variable group than in the nonvariable group. 
Chi square was 11.65 and significant beyond 
the 1% level of confidence. 

An especially interesting and relevant find- 
ing occurred when the records of children of 
different school achievement levels were 
grouped separately. The cases had been divided 
on the basis of achievement in reading and 
arithmetic for a previous study. A child who 
functioned at least .7 of a grade below his 
chronological age level was considered an un- 
derachiever. 

Results significant at the 1% or 2% level 
were found in the separate achievement groups 
at different age levels. The children who were 
underachievers in both reading and arithmetic 
had the lowest median IQ. They also showed 
more variability in IQ when childhood diseases 
had been contracted at ages two through four. 
Children who were underachievers in either 
reading or arithmetic were average in IQ, and 
their intelligence was more variable when dis- 
eases had been contracted at ages one through 
three. Those who were achieving in both read- 
ing and arithmetic were superior in median 1Q 
and showed more variability in intelligence 
when the diseases were contracted at ages zero 
through two years. 


It seems premature to attempt to answer the 
question as to whether the disturbance has a 
direct relationship to encephalomyelitis follow- 
ing childhood diseases or whether the trauma 
to the nervous system interferes with the psy- 
chosocial (ego) development of the child. Ap- 
parently there is a hierarchy of ages at which 
the diseases are most deleterious and which ap- 
pears to coincide with the emergence of lan- 
guage ideation at different levels of intelligence. 
Brief Report 
Received June 21, 1954. 
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In psychoanalytic theory, the gradual shift 
from the primary to the secondary process in- 
volves the delay and control of impulse expres- 
sion and the substitution of symbolization, fan- 
tasy, and planning for immediate response on 
a behavioral level. Rapaport’s [5] psychoana- 
lytic theory of thinking points to the inhibition 
of action designed to gratify immediate needs 
as a primary condition for the development of 
fantasy. Young children are characteristically 
lacking in the ability to inhibit motor activity 
and tend to verbalize whatever thoughts come 
to mind. Piaget [3] and Luria [1] have illus- 
trated the use of speech and symbolic circuition 
for the control of behavior. This is paralleled 
in the Rorschach test by.a gradual emergence 
of human movement (J) responses with mat- 
uration [9]. Certain psychotic groups also 
display faulty inhibition of thoughts and motor 
behavior, and are similarly lacking in the abil- 
ity to produce M. 


Rorschach [6] implied a triadic relationship 
between motor activity, motion perception, and 
the cognitive processes. Experiments by Singer, 
Meltzoff et al. [2, 7, 8], testing hypotheses de- 
duced from Werner and Wapner’s [11] sen- 
sory-tonic theory, have demonstrated one aspect 
of that triadic relationship, namely the vicarious 
relationship between motor inhibition and il- 
lusory motion perception. The purpose of the 
present investigation is to study the linkage be- 
tween motor inhibition and the inhibition of a 
cognitive process. 


1The authors are greatly indebted to VA trainees 
Louis Pietroforte, Norman Slamecka, and Norris 
Weinberg for their assistance in this experiment, 
and to Jerome and Dorothy Singer for their stimu- 
lating criticisms and suggestions. 
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The Experiment 

Hypothesis. It is hypothesized that there 
is a direct relationship between motor inhibition 
and the inhibition of an association process. 
More specifically, it was predicted that Ss with 
greater ability to voluntarily inhibit motor ac- 
tivity would be able to inhibit learned associa- 
tions and produce new ones quicker than those 
less adept at inhibiting motor activity. 

Procedure. Eighty volunteer male and fe- 
male Ss were selected haphazardly from a uni- 
versity population. They were requested to 
memorize a verbally presented list of ten pairs 
of words, to a criterion of one perfect repro- 
duction. Instructions were those used in the 
Wechsler Memory Scale [10]. The list of 
pairs was composed of stimulus words and the 
most common associations to them, as reported 
by Rapaport [4]. Association time was recorded 
to the nearest half second.* After the list was 
memorized, Ss were instructed to respond, up- 
on presentation of the stimulus word, with any 
word other than the learned paired associate. 
Responses were timed in the same manner as 
previously. The Ss were then instructed to write 
the phrase “New Jersey Chamber of Com- 
merce,” as slowly as possible, within the bound- 
aries of parallel lines drawn one-half inch 
apart. ‘They were reminded at 45-second inter- 
vals to write as slowly as possible. 


The motor inhibition task of enforced slow 
writing had been used successfully in prior ex- 
periments [2]. As far as the cognitive inhibi- 


2In the experimental procedure, the dependent 
variable was measured prior to the independent 
variable, so that any errors in timing were not bi- 
ased errors. 
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tion task is concerned, it was reasoned that the 
production of new associations to words with 
already memorized associates would involve 
two processes: (a) inhibiting the learned asso- 
ciate and (4) finding and reporting a different 
association. We shal! refer to the latter process 
as associative facility. ‘There was no apparent 
reason to believe it to be correlated with the 
ability to inhibit motor activity. The assump- 
tion was therefore made that associative facility 
would vary randomly among the experimental 
population, and that any obtained differences 
would be primarily due to systematic variation 
in the ability to inhibit associations. A partial 
test of this assumption was subsequently car- 
ried out, and is reported in the discussion of 
results. The Ss’ introspections about the cog- 
nitive inhibition task were solicited, and they 
uniformly reported either a conscious attempt 
to suppress an image of the learned associate, 
or, in the absence of an image, an awareness that 
there was a word to be avoided before an as- 
sociation could be produced. 


Treatment of the data. The population of 
80 Ss was divided into long and short motor 
inhibition time (MIT) groups at the median 
of the distribution of obtained inhibition times. 
It is of interest to note the extreme differences 
among Ss in their capacity to inhibit motor ac- 
tivity. Time for writing the experimental 
phrase varied all the way from 20 seconds to 
44 minutes, 36 seconds. The significance of the 
difference between the means of these two 
groups of 40 Ss on cognitive inhibition time 
(CIT) was calculated by Fisher’s ¢. Analysis 
of covariance was carried out to take into con- 
sideration differences between the reaction times 
of the groups on the initial criterion trial. 


Results 


As can be seen in Table 1, the mean CIT of 
the poor motor inhibitors (i.e., those with short 
MIT) is appreciably greater than that of the 
good motor inhibitors (i.e., those with long 
MIT). This difference is statistically signifi- 
cant at p < .005, with a ¢ of 3.38. Analysis of 
covariance reveals that this difference cannot 
be accounted for by the initial differences in 
reaction time that exist between the two groups. 
The obtained F value is significant at p<.005. 

There was relatively little overlapping be- 
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tween the two groups. Seventy-seven per cent 
of Ss who were least able to inhibit motor ac- 
tivity took longer to inhibit associations than 
the mean time of the better motor inhibitors. 
On the other hand, only 12 per cent of the 
better motor inhibitors took longer than the 
mean time of the short MIT group to inhibit 
associations. 


Table 1 


Mean Reaction Time and Cognitive Inhibition Time 
of Long and Short Motor Inhibition Time Groups 








Measure Short MIT group Long MIT group 





Mean reaction time, 1.0 0.9 


Paired associates* 
Mean CIT* 2.9 2.0 





* Times are group means of individual Ss’ average re- 
action times for ten responses. 


Table 2 
Analysis of Covariance of Reaction Time and Cog- 
nitive Inhibition Time of Long and Short Motor 
Inhibition Time Groups 














Adjusted 
Source df mean square # 
Between groups 1 1278.680 9.94 
Within groups 77 128.455 
Discussion 


In view of the fact that the experimental 
sample was divided at the median, instead of 
representing extremes of the population, the 
clear difference between the groups lends strong 
confirmation to the hypothesis. The ability 
voluntarily to inhibit motor activity apparent- 
ly goes hand in hand with the ability to 
inhibit associations as measured by the experi- 
mental task. This finding, however, is depend- 
ent upon the correctness of the assumption 
underlying the choice of the particular task se- 
lected to measure thinking inhibition. The 
primary issue is the relegation of associative 
facility to a secondary role while considering 
inhibition as the primary determinant of associa- 
tion times in the experimental task. 


In order to provide an experimental check on 
this reasoning, the cognitive inhibition task was 
repeated with 30 new Ss from the same gen- 
eral population. These Ss were also required to 
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Relationship Between Motor and Cognitive Inhibition 


give a single association to each of ten different 
words taken from the same source as the orig- 
inal pairs. ‘he response time was taken as a 
measure of associative facility. A random half 
of the Ss had the pairs first, while the remain- 
der began with the single-word associations. 
Division of the population into fast and slow 
CIT groups reveals a mean association time of 
1.3 seconds for the rapid thought inhibitors 
and a mean of 1.6 seconds for the slow group. 
This difference is in the inconclusive range, 


with at of 1.72 (p=.10). There is a positive, 
but not statistically significant, correlation 
(rho = .32) between the two variables. 


These results suggest that associative facility 
is perhaps more of a factor than was originally 
assumed, but nevertheless a secondary one 
which could not reasonably account for very 
much of the highly significant difference be- 
tween the groups in the original experiment. It 
is quite plausible that the ability to produce 
new associations rapidly is one of the means 
by which people are able to accomplish the 
work of inhibiting thoughts. Those who have 
this ability are to this extent better equipped 
to inhibit. ‘There are probably other abilities 
as well that facilitate inhibition. 


The findings of this investigation support 
the speculation and evidence from diverse 
sources relevant to the development of the se- 
condary process cited in the introduction. The 
results also bear, at least indirectly, upon our 
understanding of Rorschach M_ responses. 
Werner’s sensory-tonic theory suggests a vicari- 
ous relationship between perceptual and motor 
activity and enables one to predict that a de- 
crease in motor activity will be accompanied 
by an increase in the perception of illusory mo- 
tion. Experiments by Singer, Meltzoff et al. 
[2, 7, 8] confirm hypotheses deduced from this 
theory and show that the voluntary inhibition 
of motor activity results in an increase in M 
production. They also have demonstrated that 
those who are more productive of M responses 
are characteristically better able to inhibit mo- 
tor activity. The present study adds the addi- 
tional information that those who are more 
capable of inhibiting motor activity are also 
better able to inhibit established associations 
and produce new ones. It does not necessarily 
follow that M is a measure of the capacity to 
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inhibit associations as weil as motor activity, 
but these accumulated data would lead us to 
hypothesize that such a relationship exists. 

It is of interest to report the application of 
these experimental techniques to the study of 
the psychopathology of an individual clinical 
case. The patient was an intelligent manic 
whose behavior was characterized by motor 
and verbal hyperactivity and flights of ideas. 
He was examined while under treatment with 
the drug Tolserol, a muscular relaxant. He 
displayed no atypical motor behavior during the 
course of the examination. He gave neither M 
nor color responses on the Rorschach, could 
inhibit his motor activity for only 29 seconds 
(the mean of the total experimental population 
is 5 minutes, 48 seconds) ,° and was very poor 
at inhibiting associations with a mean time of 
6.4 seconds (the mean of the total experimen- 
tal population was 2.4 seconds).* It was con- 
cluded that despite the superficial effects of 
Tolserol, the patient was basically unable to in- 
hibit either motor activity or thoughts. About 
two weeks later, medication was discontinued, 
and he had a violent episode marked by unin- 
hibited verbalizations and extreme hyperac- 
tivity necessitating his being placed in seclu- 
sion. 


Summary and Conclusions 


This study was designed to test the hypothe- 
sis of a direct relationship between motor in- 
hibition and the inhibition of a cognitive proc- 
ess. Eighty Ss were divided at the median into 
two groups on the basis of motor inhibition 
time, as measured by an enforced slow writing 
task. The difference between these two groups 
in cognitive inhibition time, as measured by Ss’ 
speed in inhibiting learned word association 
pairs and producing new associations to the 
stimulus words, was found to be statistically 
significant in the predicted direction. 

It is concluded that Ss with greater ability 
to voluntarily inhibit motor activity are able to 
inhibit learned associations and produce new 
ones more quickly than those less adept at in- 
hibiting motor activity. 


Received January 18, 1954. 


8These means are merely illustrative. They are 
not norms for clinical use. 
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The term “suicidal” has been used to describe 
patients demonstrating heterogeneous kinds of 
behavior, such as (a) suicide thoughts, (4) 
suicide threats, (c) suicide attempts, and (d) 
severe depression. Some investigators have 
grouped together psychological test data from 
such individuals, as well as from those who 
later committed suicide, in an attempt to devel- 
op and evaluate psychometric devices for the 
detection of “suicidal” patients [2, 3, 4, 5, 6]. 
It is important to consider whether or not such 
grouping of patients under the class term 
“suicidal” is too broad for effective use of 
psychological tests in the study and detection of 
the patient who is apt to attempt suicide. 

Only. one published study is relevant to the 
problem of differentiating “suicidal” sub- 
groups by means of psychological tests. Farbe- 
row [1] analyzed MMPI records and other 
tests of three groups of patients in a California 
veterans psychiatric hospital. Each group con- 
tained 32 male patients as follows: (a) patients 
who made a suicide attempt within a relatively 
short period before admission, (4) patients 
who made suicide threats, and (c) patients 
selected at random, with no history of suicide 
attempts, threats, or thoughts (Control 
Group). Tests were administered to each 
patient in the first group after the attempt was 
made. The most striking finding in the MMPI 
data was the marked discrepancy in elevation 
of mean MMPI scale scores between the 
Suicide Attempt and Suicide Threat Groups. 
The scores for the Suicide Threat Group in- 
dicated a much greater severity of disturbance. 

1 From the psychiatric service, VA Hospital, Min- 
neapolis, Minnesota, and the Divisions of Psychia- 


try and Clinical Psychology of the University of 
Minnesota. 

2'W. M. Hales is now at the Area Medical Office, 
Veterans Adminstration, Fort Snelling, St. Paul, 
Minnesota. 
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Moreover, the mean scores for the Suicide At- 
tempt and the Control Groups were not sig- 
nificantly different from each other. 

Farberow’s results from the use of other 
tests also emphasized that patients who have 
made a suicide attempt are considerably dis- 
similar from those expressing suicide threats. 
The purpose of this paper is to report an inves- 
tigation conducted in the Psychiatry Section 
of the Minneapolis Veterans Administration 
Hospital. This study consisted essentially of 
a replication of that portion of Farberow’s 
research employing the MMPI in the evalua- 
tion of “suicidal” patients. 


Selection and Description of Subjects 


From the summaries of all discharged male 
patients, two groups were selected, as follows: 
(a) patients who had made a suicide attempt 
shortly before admission to the hospital (Sui- 
cide Attempt Group), and (4) patients who 
expressed suicide thoughts (Suicide ‘Thought 
Group). Although finer grouping of the 
cases was desired, it was not possible from the 
available file data. The MMPI for each of 
these patients was then obtained, but was in- 
cluded in the study only if it had been admin- 
istered within 15 days after admission and prior 
to electroshock or insulin therapy. A few addi- 
tional cases were acquired from more recent 
discharge summaries in order to obtain samp- 
les of 50 Suicide Attempt cases and of 100 
Suicide Thought cases. 

A third sample consisting of a cross section 
of the psychiatric patient population was in- 
cluded in the study for comparison with the 
Suicide Attempt and the Suicide Thought 
Groups. In a previous unpublished study, a 
sample of 250 psychiatric patients-in-general 
had been selected. This group consisted essen- 
tially of every third patient admitted during 
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a two-year period who had taken the MMPI. 
For the purposes of the present study, 39 cases 
were removed from this _ patient-in-general 
group because their discharge summaries indi- 
cated one or more attempts at, or thoughts of, 
suicide. ‘These 211 cases will be referred to as 
the Control Group. 


For each group, data were obtained on diag- 
nosis, age, education, marital status, and in- 
telligence. Only summary statistics will be pre- 
sented because the major interest of this inves- 
tigation is in the comparison of personality test 
scores. Primary diagnoses of the Suicide At- 
tempt, the Suicide Thought, and the Control 
Groups are listed in Table 1. The groups do 
not differ significantly in broad diagnostic 
categories. However, among patients classi- 
fied as neurotic, those who have made suicide 
attempts or who have engaged in suicide think- 
ing are much more frequently diagnosed as de- 
pressive reaction than are patients-in-general. 
It is quite possible that the diagnosis of de- 
pressive reaction is sometimes influenced by the 
evidence of suicidal behavior or mentation. 


Biographical data for the Suicide Attempt, 
Suicide Thought, and Control Groups, _re- 
spectively, are as follows: median years of 


age—32, 32, 32; median years of education— 
11, 12, 10; percentage of group who are mar- 
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Table 1 


Primary Diagnoses of Patients in the Suicide 
Attempt, Suicide Thought, and Control Groups 











Per cent of Per cent of Per cent of 





Diagnosis Attempt Thought Control 
Group Group Group 
(N = 50) (N= 100) (N == 211) 
Depressive reaction 34 22 4+ 
Anxiety reaction 16 24 28 
Other neurotic 6 7 26 
Total neurotic 56 53 58 
Paranoid schizophrenia 16 14 10 
Involutional 
melancholia 0 7 4 
Other psychotic 4+ 8 8 
Total psychotic 20 29 22 
Behavior disorder 18 15 15 
Organic 4 3 
No diagnosis 2 0 2 
Total sample 100 100 100 





ried or widowed—68, 52, 58; percentage who 
are divorced or separated—8, 18, 12; percent- 
age in group below 110 IQ as roughly estimat- 
ed from the Shipley-Hartford test—26, 38, 44. 

The median number of days between hos- 
pital admission and MMPI testing for the 
Suicide Attempt, Suicide Thought, and Con- 
trol Groups was 3, 4, and 3, respectively. 

In the Suicide Attempt Group, the number 
of patients making each of the various modes 
of attempt is as follows: Sedation—18; slash- 


Table 2 
MMPI Scale Raw Scores for Suicide Thought, 
Suicide Attempt, and Control Groups 




















Mean raw score Variance raw score F 

Scale Thought Attempt Control Thought Attempt Control ratio 
L 3.63 3.28 3.76 6.37 6.68 4.36 88 
F 9.63 8.68 7.40 40.83 39.62 27.72 5.28%? 
K 12.15 12.64 13.73 25.41 36.87 30.04 3.07* 
Hs 14.37 11.14 13.76 48.73 75.04 49.77 3.63* 
Hs + 5 K 20.68 17.74 20.88 41.86 45.47 42.47 4.77** 
D 33.08 28.14 28.60 40.71 44.28 49.93 16.16** 
Hy 29.76 26.66 28.47 41.76 53.70 43.58 3.64* 
Pd 23.28 23.04 20.92 36.38 50.44 37.54 5.83** 
Pd +A4K 28.24 28.26 26.40 32.26 32.27 32.60 4.58* 
Mf 26.93 26.08 25.33 28.51 29.83 29.60 2.99 
Pa 14.40 13.46 12.31 19.90 24.89 14.73 8.66** 
Pt 26.97 22.70 21.38 97.99 151.89 115.74 9.11%* 
Pi+410K 39.10 35.34 35.12 57.89 70.54 60.13 9.15** 
Sc 26.74 22.40 20.22 180.43 222.80 150.78 8.47** 
Se + 10K 38.87 35.04 33.95 128.63 117.92 92.31 7.73** 
Ma 18.20 19.58 17.76 23.80 33.56 28.33 2.41 
Ma + 2K 20.58 22.14 20.47 19.50 25.16 23.15 2.57 
Si 37.82 32.00 32.10 118.09 134.48 120.18 9.72°* 





* Significant at the .05 level. 
** Significant at the .01 level. 
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Fig. 1. Mean MMPI T-score profiles for Suicide Thought, Suicide Attempt, and Control Groups. 


ing wrists—8; gas or carbon monoxide—7 ; 
shooting —4; hanging or strangulation — 3; 
jumping from bridge—2; jumping in path of 
auto—2. For 6 cases the method was not in- 
dicated. For 2 cases listed only as “slashing,”’ 
one also used strangulation, and another gas. 


MMPI Results 


All calculations were made with raw scores, 
and the raw score mean and variance of each 


Table 3 
t Ratios for Significant Differences in Mean MMPI 
Scores between Suicide Thought, Suicide Attempt, 
and Control Groups 








Thought> Thought> Attempt> Control> Control> 





Scale Attempt Control Control Attempt Thought 
F 3.22 

K 2.38 
Hs 2.62 2.34 

Hs + .5K 2.59 3.04 

D 4.16 5.38 

Hy 2.67 

Pd 3.10 2.15 

Pd+AK 2.65 2.07 

Pa 4.09 

Pi 2.01 4.26 

Pt+ 1.0K 2.77 4.18 

S< 4.11 

Se +10K 3.92 

Si 2.69 4.26 





Note.—t ratios of 1.96, 2.58, and 3.29 are significant at 
the .05, .01, and .001 levels, respectively. 


MMPI scale for the Suicide Attempt, Suicide 
Thought, and Control Groups are presented 
in Table 2 for reference purposes. The Cannot 
Say score was zero in most cases, and is there- 
fore not considered further. Mean 7 
based on the raw scores are shown in Figure 1. 
In order to determine the significance of the 
differences between means, an analysis of vari- 
ance test was made for each scale. The Bartlett 
test indicated no significant difference in the 
variances for any scale. The F ratio for each 
analysis of variance is listed in the last column 
of Table 2, from which it can be seen that al- 
most every scale differentiates in some manner 
between the groups. For each scale with a sig- 
nificant F ratio the significance of the difference 
between the means of each pair of the three 
groups was computed by the ¢ test. Only dif- 
ferences found to be significant at or beyond the 
05 level are listed in Table 3. 

On every scale in Table 3, except for K, the 
Suicide Thought Group is significantly higher 
in mean score than either the Suicide Attempt 
or the Control Group. The Suicide Attempt 
Group is significantly higher than the Control 
Group on the Pd and Pd + .4 K scales, and 
significantly lower on Hs and Hs + .5 K. 
These findings indicate that, as a group, pa- 
tients with thoughts of suicide are much more 


scores 
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severely disturbed than either patients who 
have made a suicide attempt or patients-in- 
general, and that patients in the latter two 
categories are similar to each other. One might 
hypothesize that for many individuals, a reduc- 
tion in the degree of psychiatric disturbance 
follows a suicide attempt. However, this 
hypothesis can be evaluated only if one has test 
data for such individuals both before and after 
a suicide attempt. 

The results of this study are quite consistent 
with those of Farberow [1]. Both studies in- 
dicate that patients who have attempted suicide 
are markedly different from those who threat- 
en or contemplate suicide. In any investigation 
of the “suicidal” patient, it appears probable 
that the most meaningful results would be ob- 
tained from an analysis of groups which are as 
finely delineated as possible. 


Summary 

Psychological test data from patients demon- 
strating various kinds of “suicidal” behavior 
are usually grouped together by investigators 
who are attempting to develop suicide detection 
devices. Farberow has shown that there are 
marked differences between groups of patients 
who have made suicide attempts and those who 
have threatened suicide. The present paper re- 
ports a replication of a portion of Farberow’s 
research. The MMPI records of three groups 
of male, veteran psychiatric patients were ana- 
lyzed. The groups consisted of (a) patients 
who made a suicide attempt shortly be- 
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fore admission (Suicide Attempt Group), (4) 
patients who expressed thoughts of suicide 
(Suicide Thought Group), and (c) patients 
selected at random, with no evidence of suicide 
attempts, threats, or thoughts (Control 
Group). The two studies closely agree in in- 
dicating that groups of patients who express sui- 
cide mentation and threats are much more se- 
verely disturbed than either patients who have 
made a suicide attempt or patients-in-general, 
and that patients in the latter two categories are 
similar to each other. It may be concluded that 
in any investigation of suicide, most meaning- 
ful results might be obtained if data for indivi- 
duals with various kinds of “suicidal” behavior 
are differentially classified. 

Received December 7, 1953. 
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There is unanimous agreement among pro- 
fessional workers in the field of psychiatry that 
the sooner treatment begins after the develop- 
ment of mental illness, the greater the chances 
for recovery. As Kalinowsky and Hoch put it, 
“The most important factor in evaluating 
prognosis today is the duration of illness prior 
to treatment ; complete agreement exists among 
all workers that there is an inverse relation- 
ship between the duration of illness and re- 
covery” [1, p. 84]. 

It was the purpose of this study to evaluate 
the prognostic significance of duration of ill- 
ness by studying its relationship to outcome of 
illness after several other variables, also signi- 
ficantly related to outcome, had been con- 
trolled. 


Method 


The data used in this study were obtained 
from 486 cases admitted to Western Psychi- 
atric Institute and Clinic (WPIC), Univer- 
sity of Pittsburgh, between November 1942 
and July 1950. These cases included all per- 
sons admitted who met the following criteria: 
age between 15 and 55, no known brain dam- 
age, no mental deficiency, no serious physical 
illness, and no previous attacks of mental ill- 
ness. This sample is more fully described in a 
previous paper [2]. 

The patients were judged to be either “im- 
proved” or “unimproved” as of one year fol- 
lowing their discharge from WPIC. Patients 
were judged on the basis of social workers’ or 
psychiatrists’ reports. —They were considered 
improved if they were out and working on a 
level comparable to that on which they had 
worked prior to becoming ill, and they were 
judged unimproved if still in a hospital, or 


1At the University of Pittsburgh when this re- 
search was done. 
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if they were at home being cared for. 

Duration was measured in months; the time 
that elapsed between the first time the patient 
or relatives sought medical help for the patient 
and the time he was admitted to the hospital 
for treatment was considered the duration. It 
is admitted that this allows for a considerable 
period of time for the patient to have been ill 
before it was realized by his relatives, particu- 
larly in the case of those whose illnesses devel- 
oped insidiously, but this criterion was used 
because it was felt to be the most reliable for 
the purpose of this study. 


The relationship between outcome of illness 
and 21 variables was determined. These 21 
variables were: sex, age, marital status, nation- 
ality, occupation, economic level, body type, 
education, intellectual status, affective expres- 
sion, orientation, direction of aggression, diag- 
nosis, age at onset of illness, duration of illness, 
length of hospitalization, status upon discharge, 
precipitating stress, treatment, religion, and 
type of onset. It was found that 11 of these 
variables were related to outcome at the .01 


Table 1 


Summary Statistics of the Total Groups and 
Controlled Sample Group on Duration of Illness 











Total Controlled 
Statistic group sample group 

N 486 180 
Mean months 

Improved 21.70 34.08 

Unimproved 38.59 23.18 
Standard deviation 

Improved 22.74 37.12 

Unimproved 27.90 20.59 

ti 7.31** 2.45° 
Toiet .38** —.14 





+ Between improved and unimproved within group. 
+t Between duration and outcome, 

* Significant at .05 bevel. 

** Significant at .01 level. 
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level of confidence. These 11 were: marital 
status, affective expression, orientation, direc- 
tion of aggression, diagnosis, type of onset, du- 
ration of illness, hospital stay, status on dis- 
charge, precipitating stress, and treatment. The 
relationship between these variables and out- 
come is discussed more fully in a previous 
paper [2]. 

The correlation between duration of illness 
and outcome for this total sample of 486 was 
.38. This is presented in Table 1. It will be 
noted that the unimproved group had a mean 
duration of illness of 38.59 months, or 17 
months more than the mean for the improved 
group. 

The relationships between duration of ill- 
ness and the other variables that were signifi- 
cantly related to outcome of illness are con- 


Table 2 


Relationship between Duration of Illness 
and Other Significant Variables 











Variable Chi square p 
Affective expression 26.9 01 
Orientation 4.2 05 
Direction of aggression 24.3 01 
Diagnosis 11.3 .05 
Type of onset 79.8 01 
Precipitating stress 19.3 01 
Treatment 23.5 01 
Marital status 5.2 -30 





tained in Table 2. Duration was related to five 
of the variables (affective expression, direction 
of aggression, type of onset, precipitating stress, 
and treatment) at the .01 level. A long dura- 
tion of illness tended to be associated with an 
inappropriate affect or an absence of affect, 
with aggressive impulses directed toward the 
environment, with the insidious onset, with 
relatively little precipitating stress, and the pa- 
tients with a long duration tended to be treated 
more often with shock therapy than with other 
types of therapy. 

After the relationships between these vari- 
ables and outcome had been determined, the 
total group was divided into two groups, an 
improved group and an unimproved group. 
These groups were then matched for all of 
the significant variables except duration of ill- 
ness. This matching was accomplished by se- 
lectively dropping cases from the two groups 
until there were no significant differences be- 
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tween the improved and unimproved groups on 
any of the variables other than duration that 
were significantly related to outcome of illness. 
There were 180 cases remaining, 90 improved 
and 90 unimproved, when this matching had 
been completed. The differences between the 
controlled sample groups on the significant var- 
lables are presented in Table 3. A check re- 
vealed that there were no differences between 


Table 3 


Differences between the Controlled Sample Groups 
in the Significant Variables 














Variable Statistic* 





Diagnosis chi square — .00 


Marital status chi square — .10 
Orientation chi square —.51 
Treatment chi square — .00 
Affect t= .64 
Direction of aggression ‘= 20 
Type of onset $= 89 
Hospital stay s== 08 
Precipitating stress t= 82 





* All below .10 level of confidence. 


the groups on any of the variables not signifi- 
cantly related to outcome. After this matching 
was completed, the relationship between dura- 
tion of illness and outcome of illness for the 
controlled groups was determined. 


Results and Discussion 


A comparison of the controlled sample 
groups revealed that the unimproved group 
had a lower mean duration of illness than the 
improved group, and that this difference was 
significant at the .05 level. The biserial corre- 
lation coefficient, which had been .38 for the 
total group of 486, was reduced to —.14. 
(These results are contained in Table 1, which 
was presented earlier.) These figures tend to 
give the impression that under the controlling 
procedure used in this study, a longer duration 
is a better sign than a short duration. How- 
ever, a comparison of the frequencies having 
various durations for the improved and unim- 
proved groups, as presented in Table 4, re- 
veals that there is little difference between the 
unimproved and improved groups on number 
of patients falling into the various categories of 
duration. In the process of eliminating the ef- 
fect of the other variables, the improved group 
was left with several patients with extremely 
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Table 4 


Distribution of Controlled Sample Groups 
on Duration of Illness 











Months Improved Unimproved 
duration group group 
Under 6 12 12 
6-11 12 17 
12-23 18 11 
24-35 13 20 
Over 36 35 30 
Chi square 4.40 





long duration of illness, thus raising the mean 
for the group. 

The net result would seem to be that the 
elimination of the effect of the other variables 
significantly related to outcome also eliminated 
the relationship obtaining between duration 
and outcome. And it would appear that the im- 
portance of duration as a prognostic sign is de- 
rived chiefly from its relationship to other 
variables of more basic importance that are 
significantly related to outcome. It would ap- 
pear that the safest conclusion that could be 
reached is that the mere passage of time is in 
itself neither good nor bad so far as the possi- 
bility of “curing” a mental illness is concerned, 
but rather it is the processes that are allowed 
to continue unchecked during this passage of 
time that are of importance to the outcome of 
a mental illness. 


Summary 


It was the purpose of this study to deter- 
mine the relationship between duration of men- 





tal illness and the outcome of illness when the 
effect of other variables, significantly related to 
outcome, had been controlled. 


A sample of 486 patients was used. The re- 
lationship between outcome of illness and 21 
variables was determined. Then the group was 
divided into an improved and an unimproved 
group, and cases dropped from each of the 
groups until there were no significant differ- 
ences between the groups on any of the vari- 
ables other than duration of illness. 

It was found that after this controlling was 
completed there were no significant differences 
between the groups on duration of illness. This 
result was interpreted as indicating that the 
prognostic importance of duration of illness 
derived from its relationship to other variables 
related to the basic disease process, that the 
mere passage of time presaged neither good nor 
ill for mental illness, but rather, that it was 
the processes allowed to progress unchecked 
during this period that were of prognostic im- 
portance in mental illness. 


Received February 23, 1954. 
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It is noted occasionally by clinicians that ex- 
ogenous mentally retarded children, as com- 
pared with endogenous, are significantly less 
able to perform such memory-for-designs tests 
as that found at year 1X on the Revised Stan- 
ford-Binet Intelligence Scale. At least one in- 
vestigator [4] has suggested that their inferior 
performance is not due to faulty memory, as is 
frequently supposed, but to other factors. In an 
earlier paper [15] the author attempted to 
demonstrate that the unusual visual percep- 
tion of brain-injured subjects is one factor ac- 
counting for their relative inability to repro- 
duce visual designs. ‘The observation holds true 
even when the stimulus figures are to be re- 
produced from copy and not from memory. 
The exogenous subjects’ distorted reproduc- 
tions of visual designs appear not to be the re- 
sult of faulty memory but rather of mispercep- 
tion of the stimulus figures. 

Using the Ellis Visual Designs Test [21] 
as a means of quantifying a child’s drawing 
ability, the author noted earlier [14] that some 
mentally retarded children exhibited difficulty 
in changing their responses appropriately when 
shifting from one drawing to the next. There 
was a tendency for some of the subjects to pro- 
duce the same or similar drawings in response 
to radically different stimulus figures, which 
might be called a tendency to perseverate. 
These perseverative responses seemed to be 
more common for the brain-injured than for 
the familial defectives. It was therefore thought 
possible that a further factor contributing to 
the defective drawing performance of the ex- 
ogenous subjects might be their greater tenden- 
cy toward rigidity in conceptual thinking. 


1 The writer gratefully acknowledges the coopera- 
tion of the superintendent and staff of the Ontario 
Hospital School, Orillia, Ontario, for making avail- 
able the facilities for this study. 


In accordance with Goldstein [5], Werner 
[20], and others, rigidity in the present study 
is defined as the tendency of an individual to 
resist change maladaptively. Perseveration is 
regarded as one type of rigid response that re- 
peats itself maladaptively. Flexibility is re- 
garded as the capacity of an individual to alter 
mental sets and corresponding responses ap- 
propriately as these are required by changes in 
the stimulus situation. 

A number of investigators have found evi- 
dence that the brain-injured are characterized 
by rigidity. In 1928 Cameron [2] showed that 
brain-operated rats are less able than healthy 
animals to break a habit and form a new one. 
Maier [16] has demonstrated that operated 
rats tend to perseverate, that is, to repeat the 
same errors in successive trials. Goldstein [6, 
7], in more recent studies with brain-injured 
and normal adults, concluded that rigidity is a 
general pathological trait that is present irre- 
spective of the focus of lesion. 

Rigidity is not, however, an exclusive char- 
acteristic of the brain-injured. It has been dem- 
onstrated that mentally retarded individuals 
whose deficiency is endogenous also show rigid- 
ity. Werner [19] refers to their rigidity as 
subnormal, in comparison with that of the 
brain-injured child which is termed abnormal 
rigidity. One example of a study made of sub- 
normal rigidity is that of Lewin [12], who 
found that endogenous as compared with nor- 
mal subjects displayed a significantly higher 
degree of rigidity. The investigations of Strauss 
and Werner [18] and Carrison and Werner 
[3], dealing with abnormal rigidity, have 
shown that exogenous as compared with en- 
dogenous defective children exhibit persevera- 
tion and a general difficulty in shifting from 
one task to another. 

Many research workers, including Goldstein 
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and Scheerer [8], Weigl [19], Kasanin and 
Hanfmann [11], and Werner [19, 20], have 
devised tests in an attempt to measure the 
presence or absence of rigidity. After explor- 
ing the applicability of these tests on small 
groups of mentally defective children, the au- 
thor found them generally inappropriate. The 
instrument finally selected for use in the pres- 
ent study was a modification of a Weigl-type 
card-sorting test first described by Berg [1], and 
later by Grant and Berg [9], at the University 
of Wisconsin. The test is an objective tech- 
nique for measuring human abstraction and 
shift of set and is claimed by its authors to yield 
quantitative measures of these aspects of think- 
ing and reasoning. 


The Investigation 


Problem. The purpose of this study is to in- 
vestigate the hypothesis that exogenous as com- 
pared with endogenous mentally retarded chil- 
dren show greater rigidity in conceptual think- 
ing. 

Subjects. Two groups of mentally defective 
subjects, exogenous and endogenous, more ful- 
ly described in a previous publication [15], 
were chosen from a total population of 2,000 
institutionalized patients. The 15 exogenous 
subjects included all of the available patients 
who satisfied the rigid selection criteria. The 
15 endogenous subjects, six boys and nine girls, 
were paired as closely as possible with the ex- 
ogenous subjects for sex, chronological age, and 
intelligence. Intelligence was measured using 
the Revised Stanford-Binet Intelligence Scale, 
Form M. The two groups were composed of 
subjects between the ages of 10 and 20 with 
IQ’s between 40 and 75. Subjects were selected 
by a member of the medical staff, a geneticist, 
and the author. The presence or absence of 
brain injury in each subject was established 
(a) by examination of case history material 
and (4) by neurological examinations of the 
subjects themselves. 

Method. The modified Wisconsin card-sort- 
ing test used in the present study consists of a 
pack of 27 response cards made of white card- 
board and approximately 314 X 5 inches in 
size. Each card contains from one to three iden- 
tical figures of a single color. Three kinds of 
figures—diamonds, squares, and triangles—and 
three colors—green, blue, and red—are 


used. A single card might have one green dia- 
mond, or two blue squares, or three red tri- 
angles, or any such combination. Thus, the 
cards may be sorted according to any one of 
three different principles (a) the color, (4) the 
form, or (c) the number of figures on each 
card. !n addition to the 27 response cards which 
are socted by each subject, there are three stim- 
ulus cards which are placed on the table by the 
examiner a: guides for sorting. The three stim- 
ulus cards «re always placed in the following 
order: the card showing one green diamond; 
the card showing two blue squares; and the 
card showing three red triangles. 


When the cards are first presented to the subject 
for sorting, they are arranged in a standard order, 
but for any subsequent sortings the cards are simply 
shuffled. Sorting in terms of color is the principle 
first accepted as correct. The subject, of course, re- 
ceives no instructions to this effect. He is simply 
told that his response is incorrect when he is not 
placing the response cards in front of the stimulus 
cards according to color. After a subject has sorted 
five successive cards according to the principle of 
color it is assumed that he has grasped the principle 
that the examiner accepts as correct and is using it 
in his sorting. At this point the examiner calls such 
sortings of the cards incorrect and continues to do 
so until the subject next learns to sort them accord- 
ing to either the form or the shape of the designs 
on the cards. The same general procedure is re- 
peated until thc three sorting principles of color, 
form, and number have been successfully grasped 
or until the pack of response cards has been sorted 
completely six times. The following instructions are 
given to each subject: 

“I want you to put these cards on the table in 
front of one of the three cards already there (ex- 
aminer demonstrates). Lay the cards down one at 
a time. As you can see, the cards differ in three 
ways: in the color of the spots on each card; in the 
number of spots on each card; and in the shape of 
the spots on each card. Put each card down where 
you think it should go and I will tell you when you 
are right and when you are wrong. Remember that 
there are three ways to sort the cards. Don’t take 
too long but get as many right as you can.” 


Scoring procedure. Rigid behavior on the 
card-sorting test is scored according to three 
different criteria: 

1. Perseverative responses: A perseverative 
response occurs when a card is sorted in terms 
of a principal previously accepted as correct 
(e.g., a card sorted according to the principle of 
color when it is supposed to be sorted according 
to the principle of form). 

2. The total number of cards sorted (correct- 
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ly or incorrectly) before each of the three 
sorting principles is grasped. 

3. The time required to grasp and apply each 
new sorting principle. 


Results and Discussion 


The exogenous as compared with the endog- 
enous mentally retarded subjects showed, on 
the average, significantly more rigid behavior 
on the modified Wisconsin card-sorting test. 
As indicated in Table 1, rigidity was apparent 
not only in the subjects’ total number of per- 
severative responses, but also in the other two 
measures of sorting efficiency, that is, in the 
total number of cards sorted and in the time 
needed to grasp and apply the three sorting 
principles. 


Table 1 
Group Difference in Total Rigidity Scores 











Endogenous Exogenous 








Marking criteria subjects subjects rt 
(N15) (N15) 
Color 
Perseverative score 0 0 
Number of 
cards sorted 198 311 1.56 
Time in seconds 1544 2917 1.80 
Form 
Perseverative score 23 160 2.55® 
Number of 
cards sorted 210 580 3.70** 
Time in seconds 1551 3971 2.95* 
Number 
Perseverative score 52 248 4.91** 
Number of 
cards sorted 372 915 4.71** 
Time in seconds 2719 5993 2.91* 
Total scores 
Perseverative score 75 408 5.38** 
Number of 
cards sorted 780 1793 6.17** 
Time in seconds 5715 13035 4.31** 








+ The t ratios were calculated using Weaver's varia- 
tion [13] of the usual formula for small matched groups. 


* Significant at 5% level of confidence. 


** Significant at the 1% level. 

As mentioned in the section on scoring pro- 
cedure, the perseverative scores represent the 
number of errors made when cards are sorted 
in terms of the principle previously accepted as 
correct. This interpretation of perseveration 
agrees with that of Werner [19], who uses 
the term to indicate the persistent repetition or 
continuation of an activity once begun. A di- 
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rect comparison of the perseveration scores of 
the two etiological groups showed the endog- 
enous group mean to be 5.0 (range 2—12) 
and the exogenous group mean to be 27.2 
(range 2 — 59). In addition to the differences 
between the scores of the two groups being 
statistically significant at the one per cent level 
of confidence, there was an apparent cut-off 
score. All of the endogenous, but only three of 
the exogenous, subjects had a score of 12 or 
less. The group differences are presented graphi- 
cally in Figure 1. As was expected, a definite 
etiological difference in favor of the endogenous 
mentally retarded subjects appears to obtain. 
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PERSEVERATION SCORES 


Fig. 1. Cumulative percentage distributions of 
perseveration scores for the endogenous and exoge- 
nous groups. 


In addition to the greater number of persever- 
ative responses made by the exogenous subjects, 
both the number of responses necessary and the 
time taken to achieve satisfactorily the three 
principles were significantly greater for the ex- 
ogenous than for the endogenous mentally de- 
fective subjects. The longer time and greater 
number of responses required is considered by 
the author to be the result of the exogenous 
subjects’ reduced ability to shift their “set” 
readily from one sorting principle to another. 


ec 


In comparing the scores achieved by the two 
groups of subjects on the card-sorting test, it 
was found that both groups encountered great- 
er difficulty as the test progressed. While it has 
already been shown in Table 1 that the exog- 
enous, as compared with the endogenous, 


mentally retarded subjects showed more rigid 
behavior in the test as a whole, the groups re- 
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sponded similarly in that they both found sort- 
ing according to the principle of number more 
dificult than sorting according to the principle 
of form. This is probably due, in part at least, 
to the fact that rigidity is proportional to the 
number of principles by which the subjects have 
learned to sort the cards. The results of the 
present study, however, tend to support Heid- 
breder’s [10] study performed with normal 
subjects, which found that of the three con- 
cepts, number was the last concept to determine 
a sorting. The present study is also in agree- 
ment with the investigations reported by Sen- 
den [17] on the perceptions of the congenitally 
blind after operation. He indicates that the 
concept of color persistently dominates form 
in the first vision of such patients. Eleven 
months after operation the color names that had 
been learned were retained, but the little that 
had been learned of form was forgotten. 

A comparison of the rigidity scores in this 
investigation with the perception scores ob- 
tained in a previous study [15] denoted no 
significant relationship between these factors. 
Product-moment correlations 
group 


(endogenous 
.20; exogenous group — .10) were 
not significant for either etiological group. 
This would tend to indicate that visual percep- 
tion, as measured by Lissajou’s figures, is rela- 
tively independent of a subject’s ability to shift 
his set from one task to another on a card-sort- 
ing task. 


Summary and Conclusions 


Previous investigations [5, 14] have indi- 
cated that exogenous mentally retarded children 
are significantly less able than those of endog- 
enous etiology to reproduce visual designs 
from copy. In a previous paper [15] the au- 
thor provided evidence that the unusual visual 
perception of the exogenous defectives was one 
factor accounting for their poor drawing per- 
formance. The purpose of the present study 
was to investigate the hypothesis that the rela- 
tive inability of the brain-injured to reproduce 
visual designs from copy, in comparison to fa- 
milial defectives, is due to rigidity in conceptual 
thinking. 


In the present study a modified version of 
the Wisconsin card-sorting test was employed 
to study rigidity in conceptual thinking in exog- 
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enous and endogenous mentally retarded chil- 

dren. ‘The subjects from the two groups were 

paired on the basis of sex, chronological age, 
and intelligence. 

It was demonstrated that the brain-injured 
are significantly more rigid in conceptual think- 
ing as shown by their greater tendency to per- 
severate on a card-sorting task. ‘he exogenous 
child is indeed less able to shift his mental set 
from a sorting principle such as color to another 
such as form or number. Such findings warrant 
the conclusion that the relatively poor drawing 
performance of exogenous defectives on such 
memory-for-designs tests as that found at year 
IX on the Binet are not due to faulty memory 
but to such factors as perseveration and rigidity 
in conceptual thinking. 

Received January 14, 1954. 
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The diagnosing of brain injury is of major 
importance. Until recently the responsibility 
for this diagnosis rested solely with the medi- 
cal profession. Today it is recognized that psy- 
chological findings may contribute to the final 
diagnosis along with the neurological examina- 
tion and such laboratory tests as the electroen- 
cephalogram. Although a correct diagnosis is 
important for mature individuals, it is of even 
greater consequence for young children be- 
cause of the impact of brain injury on the de- 
veloping organism [4]. Brain-injured adults re- 
tain much of what they have learned even 
though the acquiring of new skills is impaired. 
The situation is more serious, however, for 
children who have sustained cerebral insult be- 
fore many tasks are normally learned. If a cor- 
rect diagnosis is not made, they may not receive 
the specialized training which they need in or- 
der to learn normally expected skills. Methods 
have been especially designed to teach them 
such necessary functions as reading and arith- 
metic fundamentals [16]. If a diagnosis of pri- 
mary amentia is made rather than of secondary 
amentia due to brain injury, these children are 
frequently placed in institutions for the endo- 
genous mental defective and barred from an 
opportunity for even rudimentary academic 
learning [5]. 


Two assumptions are made when a psycho- 
logical test is expected to differentiate between 
young children with and without brain injury: 
(a) that children’s abilities are sufficiently de- 
veloped and specialized at an early age for 
differential patterns to emerge, and (4) that 
the test is sensitive enough to tap varying de- 


1Acknowledgment is made to the National In- 
stitutes of Health of the U. S. Public Health Serv- 
ice for a fellowship grant to the author to conduct 
this study and to Miss Louise R. Hewson, Director, 
Psychology Department, Neurological Institute, New 
York City to collect the data. 
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grees of ability [2]. ‘The fact that test items in 
both verbal and performance areas are admin- 
istered to children and infants as young as four 
weeks on the Gesell Developmental Schedules 
and at two months on the Cattell Infant ‘Tests 
lends weight to the concept of differential abil- 
ities in the young child [1, 9]. 

On the basis of previous research with older 
children there is reason to suspect that young 
brain-injured children have difficulty in con- 
ceptual thinking, in visual-motor and percep- 
tual judgment, and there is also the possibility 
of more general mental retardation [7, 13, 14, 
17, 21]. Whether or not intellectual impair- 
ment follows a brain injury depends on the 
area of the brain affected. If the lesion is in the 
cerebral cortex, intellectual impairment or “‘def- 
icit” is a definite possibility although even here 
not an inevitable consequence [18]. Literally, 
any case of feeblemindedness might be con- 
sidered as possibly due to birth lesion when one 
considers the whole process of fetal develop- 
ment and the difficulties of childbirth. 


Method 


The instrument chosen in this investigation 
to test varying degrees of ability was the Mer- 
rill-Palmer Scale of Mental Tests [19]. It 
was selected primarily because it consists of a 
battery of verbal and performance tests that 
permits scoring for different degrees of ability 
through the preschool years. In addition, it has 
strong appeal for young children and very few 
resist “playing the games.” Motivation is an 
important factor since cooperation is frequently 
difficult to obtain in brain-injured children on 
tests without intrinsic appeal. In fact, electro- 
encephalograms are often reported to be un- 
satisfactory in these children because of lack 
of cooperation. 

It is hypothesized that young children with 
brain injury will show decreased efficiency on 
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tests involving conceptual thinking, visual-mo- 
tor skill, and perceptual judgment. Specifically, 
it is expected that the brain-injured group 
should show significantly lower means on the 
selected Merrill-Palmer tests that purport to 
measure these abilities than the control group. 
A brain-injured child in this study is defined 
as one who has suffered a brain lesion due to 
infection or injury occurring before, during, or 
after birth. Conceptual thinking is conceived as 
the ability to form a concept, to classify ac- 
cording to a common factor. Visual-motor skill 
is dependent upon eye-hand coordination, finger 
dexterity, speed of reaction time, spatial evalu- 
ation, and visual memory. Perceptual judg- 
ment implies the discriminative observation of 
differences, relationships, and organizations. 

The experiment was designed for a brain- 
injured group of 100 children and two non- 
brain-injured groups consisting of 100 behav- 
icr-problem and 100 foster-home children to 
whom the Merrill-Palmer and the Revised 
Stanford-Binet, Form L, were administered. 
The selection of behavior-problem children for 
comparison with the brain-injured group was 
niade partly because of their availability in the 
clinic as a non-brain-injured population but 
muinly because differentiation between children 
with brain injury and those with behavior 
problems is an especially important issue which 
the neuropsychiatrist refers to the psychologist 
[3, 10, 11, 12]. Comparison could have been 
made with so-called “normal” children in nurs- 
ery school, kindergarten, and primary grades, 
but the foster-home group was selected instead 
because from the standpoint of this study there 
would have been several disadvantages with a 
normal group. First, there is screening of chil- 
dren for admission to these educational groups, 
and those with low intelligence quotients 
would probably have been eliminated, especial- 
ly where there were physical stigmata. Second, 
the testing could not have been done by the 
same examiners at the same place, whereas 
identical conditions prevailed for the three 
groups that were selected. 


The only criteria for selection of subjects 
besides their diagnosis were chronological age 
from 3 years, 0 months to 7 years, 10 months; 
Intelligence Quotients of at least 45 on the 
Revised Stanford-Binet, Form L; and basal 
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age at least 30 months on the Merrill-Palmer 
[20]. ‘These limitations stem from the selection 
of Merrill-Palmer tests and a choice of a pre- 
dominantly preschool population. ‘The mean 
Stanford-Binet 1Q for the brain-injured and 
foster-home children was found to be 93 and 
for the behavior-problem group 89. Although 
no attempt had been made to match the three 
groups for sex, the brain-injured were found to 
have a one-to-one ratio, while both the non- 
brain-injured groups had a higher proportion 
of boys. None of the children had visual or 
auditory impairments, nor was there a differ- 
ence in the socioeconomic backgrounds. 

The etiologies in the exogenous group were: birth 
injury, 5; meningitis or encephalitis, 15; hypoplasia 
of the brain, 23; tumor of the brain, 10; 
petit mal epilepsy, 16; cortical seizures, 11; 
cephalus, 9; 
electroencephalograms 


grand or 
hydro- 
brain-injury etiology unknown, 11. The 
and 
were abnormal. The behavior-problem and foster- 
home children are known as _ non-brain-injured 
groups because their developmental histories and 


pneumoencephalograms 


neurological examinations gave no evidence of a 
lesion of the central nervous system. 

The tests selected were the Action Agent, the 
Buttons, the Copying a Circle, Cross, and Star, the 
Seguin Formboard, the Pyramids, the Pink Tower, 
the Mare and Foal, and the Picture Puzzles because 
they tap a variety of abilities as well as provide for 
varying degrees of proficiency among children from 
30 to 77 months, The tests usually administered be- 
low 30 months were omitted because they are based 
on the all-or-none principle of scoring; for example, 
the child can either cut with a pair of scissors or he 
cannot; he can either identify himself in a ‘mirror 
or he cannot. 


An analysis of the abilities in the Merrill- 
Palmer was made as a preliminary step so that 
the abilities involved in each test were defined 
prior to the analysis of the relevant data. ‘Lhree 
competent psychologists who had clinical ex- 
perience with the Merrill-Palmer scale and had 
taught and demonstrated its technique to grad- 
uate students and externs were chosen to check 
on the writer’s analysis of abilities. The judges 
were sent the writer’s analysis of the abilities 
involved in the Merrill-Palmer tests together 
with a list of definitions for the abilities. The 
combined efforts resulted in a grouping of the 
tests in terms of the abilities in each test as 
they related to the hypothesis under investiga- 
tion. For example, under conceptual thinking 
was listed the test which involves this ability 
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primarily; under visual-motor skill those tests 
which embody spatial evaluation, speed of re- 
action time, and visual memory; and under 
perceptual judgment tests which are predomi- 
nantly dependent upon this ability. 


Results 


The Merrill-Palmer mean scores for each 
of the three diagnostic groups ranged from 3.0 
to 4.8, where there is a possible range from 0 
to 7.0. When the ¢ test of the significance of 
the differences between the means of the three 
groups, for each subtest, was computed, it was 
found that no test was significantly different at 
the .05 level in all instances. When the ¢ test 
was applied to all differences between subtest 
means within each group, no one test was 
found to reach significance at the .05 level in 
all seven instances. Thus, the null hypothesis 
must be accepted in terms of the criterion, and 
the differences among the three groups and be- 
tween tests in any one of the groups must, 
therefore, be attributed to chance. Table 1 
shows the ¢ tests between the means of the 
eight Merrill-Palmer tests for each pair of di- 
agnostic groups. 


Discussion 


The results of this investigation do not 
demonstrate that young children with brain in- 
jury show decreased efficiency on tests presum- 
ably measuring conceptual thinking, visual- 
motor skill, and perceptual judgment. This 
may be because abilities at this young age level 
are general rather than specific [8]. Other 
studies which report significant differences 
dealt with older children and adults. It is also 
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possible that the Merrill-Palmer as a measur- 
ing device is not a sensitive enough instrument 
to differentiate degrees of conceptual thinking, 
spatial evaluation, and perceptual judgment 
compared to those tests which have been spe- 
cifically designed for differential diagnosis. 
The fact that little relationship was found be- 
tween Stanford-Binet IQ’s and Merrill-Pal- 
mer test scores tends to support this interpreta- 
tion. ‘The present research is in line with the 
recent attempts to explore the contributions of 
intelligence tests to neuropsychiatric diagnosis. 
Since these tests were designed to measure 
global intelligence and are based on theory di- 
rected toward that end, it should be no dis- 
paragement of the Merrill-Palmer that it does 


not perform a function foreign to its basic pre- 
mise [15]. 


Summary 


This study investigated the ability of se- 
lected subtests of the Merrill-Palmer scale to 
differentiate between brain-injured and non- 
brain-injured children, three to seven years of 
age. The experimental group of 100 brain-in- 
jured children was compared to two control 
groups of 100 behavior-problem children and 
100 foster-home children. Analyses were made 
by ¢ tests of the differences of mean subtest 
scores within each group. Although a few 
scattered ¢ tests showed statistical significance, 
no test pattern emerged that validly differen- 
tiated the brain-injured from the other groups. 
The null hypothesis must be accepted. It is con- 
cluded that subtests of the Merrill-Palmer 
scale are not useful for the differential diag- 
nosis of brain-injured children from behavior- 














Table 1 
t Tests between Means of Eight Merrill-Palmer Tests for Each Pair of Diagnostic Groups 
Tests a A a 
Picture Action Pink Mare Circle 
Groups Seguin Puzzles Buttons Agent Tower & Pyramids Cross, 
Foal Star 
Brain-injured vs. 
behavior problem 1.27 1.66 52 1.76 1.84 .90 1.74 92 
Behavior problem vs. 
foster home 2.21* 2.70** 23 3.02** 1.49 83 1.49 1.60 
Brain-injured vs. 
foster home 88 1.01 .78 5.06** .30 .06 .22 58 





* Significant at .05 level of confidence (1.96). 
** Significant at .01 level of confidence (2.576). 
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problem or foster-home children. 
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Sex Differences on the Revised Beta Examination 


George Lavos 
Michigan School for the Deaf 


The Revised Beta Examination is a non- 
language test measuring “general intellectual 
ability” for those 16 years of age and older 
[1, p. 2]. No reports of its use with the deaf 
appear in the literature although it is adapt- 
able for use with the deaf in administration, 
format, and nonlanguage response. 


The Problem 


The Revised Beta Examination is provided 
with norms based on white male adults. ‘These 
men were selected so that they would represent 
proportionately in the normative population 
the educational and socioeconomic status of the 
adult white males in the 1940 U.S. census. Al- 
though the standardization group is limited to 
men, the Manual states that “the Examina- 
tion has been used for testing women as well 
as men for many years and no report has been 
found indicating that different norms were re- 
quired for the different sexes” [1, p. 6]. 


The assumption that the norms based on 
men are appropriate for women should be 
tested before use of the examination is recom- 
mended for deaf women and older girls. The 
problem is, then, when used with deaf youths is 
there a sex difference in the intelligence quo- 
tients based on the Revised Beta Examination 
that cannot be attributed to chance sampling in 
the population ? 


Method 


The records of 188 deaf pupils, between the 
ages of 16 and 19 at the time of testing, were 
available. ‘The average age at the time of ad- 
ministering the test was 17-3. The pupils were 
accustomed to testing since the Beta test was 
the third group test of intelligence used in the 
school from which the data were obtained. 
There were 79 girls and 109 boys in the group. 
All were regularly enrolled pupils in the school 
and had severe hearing losses. 

The intelligence quotients for the total 
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group ranged from 62 to 128. These quotients 
were calculated according to the Lindner-Gur- 
vitz procedure recommended for use with the 
Beta test. 

In order to find out whether there is a sex 
difference on the Beta, it is necessary to ascer- 
tain whether the performance of the two sexes 
is the same on similar tests. Since the Beta was 
the third of a series of tests of nonlanguage in- 
telligence used with the subjects of the study, 
results of the first two tests could be used to 
assess the possibility that a sex difference al- 
ready exists in the group. The critical ratio of 
the difference between the means of the quo- 
tients for boys and girls on the first of the two 
tests given earlier, the Chicago Non-Verbal 
Examination, was 1.44. The critical ratio for 
the mean quotients from the second test, the 
Pintner Non-Language Test of Mental Abil- 
ity, Intermediate Series, was .005. Both ratios 
indicated that no sex differences exist on the 
Chicago and the Pintner tests that cannot be 
attributed to chance factors. 


Results 


The mean Beta intelligence quotient of the 
girls (94.4) was lower than that of the boys 
(103.0). The critical ratio of the difference 
in means was 4.34. The probability is less than 
1 in 1,000 that a critical ratio this large can 
arise by chance. There is a reliable difference 
in the means of deaf boys and deaf girls on the 
test ; consequently, the two sexes cannot be con- 
sidered to be samples from a common popula- 
tion with respect to the capacities measured by 
the test. 

In the light of this finding it is desirable to 
see on which subtests of the Beta deaf boys and 
girls differ significantly in performance. By 
using the weighted scores for each subtest that 
are provided in the Lindner-Gurvitz standard- 
ization, it is possible to compare directly any 
person within the age range from 16 to 19, 20 
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to 24, and so forth, without considering growth. 
Thus the boys and the girls, each group rang- 
ing in age from 16 to 19, can be directly com- 
pared without regard to variations in age with- 
in that range. 


The differences in means of the weighted 
scores for the boys and the girls on each of the 
six subtests of the Beta were tested for signifi- 
cance. Three mean differences were statisti- 
cally significant, and these were in favor of the 
boys. The three subtests in which significant 
differences appeared were “error recognition,” 
“paper form board,” and “picture completion.” 

The subject matter of the drawings in the 
items for “error recognition” is largely mas- 
culine. The “paper form board” subtest is sim- 
ilar to those appearing in mechanical aptitude 
tests. In “picture completion” there is no pre- 
ponderance of masculine or feminine orienta- 
tion. 


Summary 


In order to test the assumption that the 
norms for the Revised Beta Examination can 


be used with deaf women, the norms being de- 
rived from hearing males only, the test results 
of 79 deaf girls and 109 deaf boys between 16 
and 19 years of age were analyzed. It was 
shown that the performance of these subjects 
was not indicative of a sex difference in intelli- 
gence quotient on the Chicago Non-Verbal Ex- 
amination and the Pintner Non-Language 
General Ability Test, which had previously 
been given to the subjects. On the Beta, how- 
ever, a significant sex difference in mean intel- 
ligence quotient existed in favor of the boys. 
Subtest analysis located the difference in three 
subtests, two of which are masculine in orien- 
tation. It is concluded that the Beta test can- 
not be used with deaf girls of 16 to 19 years of 
age without appropriate norms. 
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A Validation of a Bender-Gestalt Scoring; System 


Murray Lonstein 
VA Hospital, Lebanon, Pennsylvania 


The Bender-Gestalt test (B-G) has become 
a part of test batteries in many hospitals and 
clinics throughout the country. Its need for 
quantification and validation has been recog- 
nized, and, accordingly, scoring systems have 
been devised by several investigators [1, 4, 5]. 
One such scoring system, constructed by Pascal 
and Suttell [4], appears worthy of further 
study in view of the fact that its authors have 
claimed that the method discriminates normal 
subjects from neurotics and psychotics. Further- 
more, Robinson [6] found that this system 
differentiates the B-G performances of paretics 
and schizophrenics, and Cornutt [2] supported 
the claims of Pascal and Suttell in regard to 
scoring and collection of their normative data. 


The present study was designed to validate 
further the Pascal-Suttell scoring system and 
to establish its practical usefulness in a hospital 
setting. It was held that even if the system is 
not sensitive enough to distinguish neurotic 
from normal subjects, as Gobetz [3] claimed, 
its efficacy in separating psychotic from non- 
psychotic patients would merit its continued 
use. 


Procedure 


A total of 96 B-G records of psychiatric pa- 
tients in a veterans hospital was scored by the 
author according to the directions given by Pas- 
cal and Suttell. Briefly, this technique involves 
an analysis by the psychologist of Designs 1-8, 
which are scored according to criteria given in 
their manual. The number of points for each 
specified deviation increases with its severity. 
The sum of these points is the raw score, which 
is converted into a standard measure or z score. 

After the records were scored, the psychiatric 
diagnoses of the patients were obtained and the 
records were placed into two groups, “psycho- 
tic’ and “nonpsychotic.” In the psychotic group 


1From the VA Hospital, Lebanon, Pennsylvania. 
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there were 41 schizophrenics, 4 psychotics with 
organic brain disease, and 2 manic-depressives. 
In the nonpsychotic group there were 40 anxi- 
ety reactions, 6 passive-aggressive reactions, 
1 obsessive-compulsive reaction, 1 dissociative 
reaction, and 1 alcoholic. 

Since the Pascal-Suttell z scores are based on 
norms that exclude subjects whose education 
is below the ninth grade, 23 patients who did 
not meet this standard were not used in the z- 
score comparison. They were included, how- 
ever, in the raw score analysis. 


Results 


As indicated in Table 1, the means of the 
standard score distributions of the two groups 
differed significantly; likewise, the means of 
the larger raw score distributions also differed 
significantly. These findings indicate that the 
Pascal-Suttell scoring system meets the statisti- 
cal criterion in differentiating psychotic from 
nonpsychotic patients, using either 
standard scores. 


Taw or 


Table 1 


Statistical Comparisons of B-G Standard and 
Raw Scores of Psychotic and Nonpsychotic Groups 








Standard scores Raw scores 





Statistic Non- Non- 
Psychotic psychotic Psychotic psychotic 
N 36 37 47 49 
M 72.19 56.05 35.30 23.96 
SD 22.48 14.12 22.56 14.53 
CR 3.67 (p < .001) 


2.92 (p < .01) 





Although the null hypothesis may be reject- 
ed with a high degree of confidence, it was 
deemed more appropriate to evaluate this tech- 
nique as a practical method by determining from 
the data the percentage of true and false posi- 
tives. In order to satisfy this important cri- 
terion, it was necessary to find appropriate cut- 
off points to separate the two groups. Pascal 
and Suttell report that z scores between 50 and 
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72 are suspect for psychiatric illness. A x score 
of 60, one standard deviation above their nor- 
mal group mean of 50, is suggested by them as a 
reasonable cutoff score in differentiating be- 
tween patients and nonpatients. 

Inspection of the data reveals that of the 36 
psychotic records on which z scores were com- 
puted, 24 patients had scores greater than the 
suggested cutoff score of 60, and 12 had scores 
below 60. As indicated in Table 2, 66.66 per 
cent of the psychotics were correctly iden- 
tified. Of the 37 nonpsychotic patients, 13 had 
scores above 60, whereas 24 had scores below 
60; that is, 64.86 per cent were correctly iden- 
tified. In the total sample of 73 patients, the 
percentage of true positives was 65.76 and the 
percentage of false positives was 34.24. 


Table 2 


Percentage of True and False Positives with Cut- 
off B-G Scores of 60 and 65 








Percentages Cutoff score Cutoff score 





at 60 at 65 
Yo psychotics _ 
correctly identified 66.66 63.89 
Yo nonpsychotics 
correctly identified 64.86 73.38 
Total % 
false positives 34.24 28.77 
Total % 
true positives 65.76 71.23 





Since all the subjects in this study were hos- 
pitalized and therefore maladjusted to some 
degree, it seemed reasonable to select a some- 
what higher cutoff score; accordingly, a cutoff 
score of 65 emerged as a more effective score 
for reducing the total percentage of false pos- 
itives. Only 8 of the 37 nonpsychotic records 
had z scores over 65, and 13 of the 36 psychotics 
had scores below 65; that is, with the higher 
cutoff score, 1 additional psychotic was mis- 
identified, but 5 more nonpsychotics were cor- 
rectly identified. The percentages in Table 2 
reflect this trend and show the total percent- 
age of true positives as 71.23, and the total 
percentage of false positives as 28.77. In other 
words, the technique correctly separated psy- 
chotics from nonpsychotics in about 7 out of 
10 cases when a cutoff score of 65 was used. 

Since all of the B-G performances were 
timed when the test was administered, it was 
believed that knowledge of possible differences 
between the two groups on the time variable 


would be helpful diagnostically. Accordingly, 
the time measures (seconds taken to copy all 
of the designs) were compared on a group basis. 
The psychotic group’s mean time measure was 
445.03 seconds, with a sigma of 290.25 sec- 
onds; the nonpsychotic group averaged 331.05 
seconds, with a sigma of 112.82 seconds. The 
critical ratio derived in this comparison was 
2.29, significant beyond the .05 level of con- 
fidence—that is, psychotic patients worked 
more slowly on the test than did nonpsycho- 
tic patients. 


Discussion 


Although the Pascal-Suttell scoring system 
meets a high statistical level of confidence in 
differentiating between hospitalized psychotic 
and nonpsychotic patients, it is by no means 
infallible in the practical, clinical setting. 
Nevertheless, in practical work it can discri- 
minate between these two groups on a better 
than chance basis. The variables selected for 
scoring are therefore of diagnostic importance 
and perhaps should be studied by those who 
use this test even though they may not formally 
score each B-G record. However, since the 
scoring procedure can be learned easily and a 
record can be scored quickly, the technique 
should be of practical usefulness in clinical 
settings. 

As Pascal and Suttell point out, an indivi- 
dual z score derived by use of their system must 
be interpreted with caution. Although a high 
z score suggests psychiatric illness, it does not 
always mean that the subject is psychotic. Some 
factors incidental to the testing situation, such 
as fatigue, may contribute to high scores. Like 
all such test measures, the z score must be 
viewed along with other test scores and clinical 
data. Furthermore, the fact that the criterion 
used in this study is psychiatric diagnosis im- 
poses some limitations on the reliability of these 
results. 


Summary 

A validating study was carried out on the 
Pascal-Suttell scoring system of the Bender- 
Gestalt test. The records of 96 psychiatric 
patients were scored, and it was found that this 
technique differentiated psychotic from non- 
psychotic records by meeting statistical criteria 
and, in a limited way, practical criteria. An in- 
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cidental finding is that psychotic patients took 
more time in reproducing the designs than did 
nonpsychotic patients. 


Received December 16, 1953. 
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Gellerman’s Complex Crossover Design’ 


Julian C. Stanley’ 


Department of Education, University of Wisconsin 


In discussing the analysis of his Form I and 
II Arthur scores, Gellerman [1, p. 129] states: 
“The F-tests were designed after the manner 
described by Grant...” [2]. Yet on page 127 
he indicates that assignment to the ‘wo coun- 
terbalanced order-of-testing groups (I-II, II- 
I) was not random: “Subjects were selected 
by the matched-pair method to insure minimal 
group differences. The factors controlled in se- 
lection were sex, chronological age, mental age, 
previous experience with the Arthur scales, 
and etiological classification.” 

Instead of partitioning his total sum of 
squares into five parts (orders, individuals 
within orders, sessions, forms, and individuals 
X sessions within orders), Gellerman could 
have performed the following more extensive 
analysis: sexes, pairs within sexes, individuals 
within pairs, sessions, sessions sexes, sessions 
X pairs within sexes, forms, forms sexes, 
and forms X pairs within sexes. 


Gellerman’s data are no longer available, so 
it is impossible to determine definitely whether 


1An extended report of this study may be ob- 
tained without charge from Julian Stanley, Educa- 
tion Building, University of Wisconsin, -Madison, 
or for a fee from the American Documentation In- 
stitute. To obtain it from the latter source, order 
Document No. 4306 from ADI Auxiliary Publica- 
tions Project, Photoduplication Service, Library of 
Congress, Washington 25, D.C., remitting in ad- 
vance $1.75 for microfilm or $2.50 for photocopies. 
Make checks payable to Chief, Photoduplication 
Service, Library of Congress. 


2The writer is indebted to V. N. Amble, E. E. 
Cureton, A. L. Edwards, P. O. Johnson, O. Kemp- 
thorne, E. F. Lindquist, and W. J. Moonan for help- 
ful comments concerning an earlier draft of the full 
report. 


or not his conclusions would be altered by the 
complex breakdown. To illustrate the two de- 
signs and their analyses in considerable detail, 
the present writer divided 28 students random- 
ly into two groups of 14 each. One group re- 
ceived the two forms of a locally prepared final 
examination in A-B order; the other group 
took Form B first. Form A proved significant- 
ly harder than Form B. 


Then Gellerman’s design was simulated by 
artificially assigning “sexes” and by matching 
like-sexed students across orders. The “error” 
mean square for form differences dropped from 
11.4 to 4.9. These were not Gellerman’s scores, 
but it appears reasonable to surmise that his 
MA difference would also have been found 
more significant, rather than less so, if he had 
employed the longer analysis. No other com- 
parisons were basic to his study. 

Gellerman need not have matched subjects, 
or else he might well have taken matching ex- 
plicitly into account. The basic crossover de- 
sign is much easier to plan and analyze. ‘There- 
fore, despite greater possible efficiency of the 
nine-part analysis, the simpler one seems prefer- 
able unless added comparisons themselves are 
of interest. 

Brief Report 
Received March 15, 1954. 


References 


1. Gellerman, Saul W. Forms I and II of the Ar- 
thur Performance Scales with mental defectives. 
J. consult. Psychol., 1952, 16, 127-131. 

Grant, David A. The latin square principle in 
the design and analysis of psychological experi- 
ments. Psychol. Bull., 1948, 45, 427-442. 


N 





Journal of Consulting Psychology 
Vol. 18, No. 5, 1954 


Mental Age Equivalents for the Revised 
Stanford-Binet Vocabulary Test’ 


Edward E. Cureton 


University of Tennessee 


Neither Terman and Merrill [3] nor Mc- 
Nemar [2] give a table of mental age equiva- 
lents for the vocabulary test of the 1937 Re- 
vised Stanford-Binet Tests of Intelligence. 
McNemar presents a table giving the mean 
and standard deviation of the vocabulary scores 
for each age group of the standardization 
sample from 7 to 18 [2, p. 141, Table 44], 
but says: “We do not deem it necessary or 
desirable to present a table of mental-age 
equivalents . .”’ [2, p. 140]. This judg- 
ment is apparently based on the fact that the 
vocabulary test, which consists of only 45 
items, is not highly reliable. 

Both McNemar, and Terman and Merrill 
note that the vocabulary test has higher cor- 
relations with total score than any other. Ex- 
aminers frequently use it as a brief verbal 
scale, moreover, so it seems worth while to 
make available to them the best mental age 
equivalents that can be derived from the pub- 
lished standardization data. 


Derivation of Equivalents 


The first column of Table 1 lists the age 
groups in which the vocabulary test is used in 
MA determination. The number of cases in 
each group from 6 to 14 is a little over 200, 
and in the groups from 15 to 18 it is a little 
over 100. All children in the standardization 
groups were within one month, plus or minus, 
of a birthday, so for practical purposes each age 
group may be taken to consist of children all of 
whom are exactly that age. 

Column 2 of Table 1, taken from Mc- 
Nemar’s Table 44, gives the mean vocabulary 

1Revision of a paper presented to the Tennessee 


Psychological Association at Nashville, Tennessee, 
January 23, 1954. 
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Table 1 


Raw and Smoothed Mean Vocabulary Scores and 
Mean Composite Mental Ages of Age Groups 
6 to 18 Inclusive, 

Revised Stanford-Binet Tests of Intelligence 














Age Mean vocabulary score Mean mental age 








group haw Smoothed Kaw Smoothed Smoothed 
rn. | 5.8* 6.09 6.09 1 
7 7.0 7.0 7.19 7.19 7-2 
8 8.3 8.3 8.23 8.29 8-3 
9 10.0 9.8 9.43 9.39 9-5 
10 11.4 11.6 10.47 10.49 10—6 
11 13.7 13.5 11.49 11.54 11—6 
12 15.4 15.5 12.39 12.51 12—6 
13 17.4 17.1 13.50 13.33 13-4 
14 18.2 18.5 13.80 14.01 14-0 
15 20.0 19.8 14.73 14.66 14-8 
16 21.2 21.0 15.24 15.29 15-3 
17 22.0 21.9 15.76 15.77 15-9 
18 22.5 22.5 16.09 16.09 16-1 





* Extrapolated. 
scores for age groups 7 to 18. Why he did not 
give the average for age 6 is not clear, as vo- 
cabulary is one of the 6-year tests of Form L. 
Since these mean scores vary irregularly from 
their general trend because of sampling errors, 
is was necessary to smooth them. This was 
done in two steps. First, a five-point weighted 
moving average, which preserves linear, par- 
abolic, and cubic trends over each set of five 
points but removes irregularities of higher 
order, was applied [1, p. 374, Formula 29.7, 
ao = 5]. Since minor irregularities may gen- 
erate a spurious cubic trend over as many as 
five points, this formula tends slightly to under 
smooth, and it leaves unsmoothed the two 
points at each end of the series. A seven-point 
formula would have given better smoothing in 
the middle range, but it would have left three 
points at each end (half the points in the ser- 
ies) unsmoothed. In the second step, the first 
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differences of the five-point-smoothed series, 
including the two unsmoothed points at each 
end, were set down, and a few additional 
changes of one digit after the decimal point 
were made in such a manner as to regularize 
these differences. From the figures at the top 
of the smoothed series and of the difference 
table, one additional value was added to the 
series by extrapolation at age 6. Column 3 of 
Table 1 gives the smoothed series. 


Terman and Merrill give the Form L and 
Form M mean 1Q’s for all age groups of the 
standardization sample [3, p. 35, Table 5]. 
The two mean IQ’s for each group were aver- 
aged and then multiplied by the age, or by the 
equivalent chronological age divisor in the case 
of age groups 14 to 18 [3, p. 31, Table 4], 
to obtain the mean L—M composite mental age. 
These means are given in Column 4 of Table 
1. The same smoothing procedure was applied 
to them also. In the second stage, no change 
as great as one digit in the first decimal was 
made. The smoothed values, in years and hun- 
dredths, are given in Column 5 of Table 1. 
These values were then converted to years and 
months as shown in Column 6. 


The entries in Columns 3 and 6 of Table 
1 were then plotted on a large sheet of 1/10- 
inch, cross-section paper, using 1/2 inch per 
unit of the vocabulary score and 1/10 inch per 
month of mental age. It was noted that the 
trend between the points for ages 10 to 18 was 
almost exactly linear. 

McNemar reported that two subjects, one 
at age 17 and one at age 18, obtained the 
highest vocabulary score, 38 [2, p. 140]. This 
performance was judged by the writer to be 
approximately equivalent in rarity to IQ 160, 
or adult mental age 24-0. One point was there- 
fore added to the chart at score 38 and MA 
24-0. A straight line drawn through this point 
and the point for age group 10 passed exactly 
through the point for age group 18, and no 
one of the points for age groups 11 to 17 de- 
viated from it by as much as 1/16 inch on the 
scale used. Hence an upward extrapolation in 
a straight line from the 10-year to 18-year 
trend would give exactly the same result as the 
interpolation to the point at score 38 = MA 
24-0. This exact agreement is in considerable 
part coincidental, of course, but it gives us 


some further confidence in the accuracy of the 
mental age equivalents of scores higher than 
that of the 18-year age group average. 

The line was continued downward in a 
smooth curve through the averages for age 
groups 6 to 9, and extended one score point 
further downward and two score points fur- 
ther upward. 

The mental age corresponding to each 
score from 5 to 40 was then read from the 
curve. Accuracy of reading was checked by 
forming a difference table of the mental age 
equivalents, and a few changes of one month 
were made in such a manner as to regularize 
these differences. The resulting mental age 
equivalents are given in Table 2. 


Table 2 


Mental Age Equivalents of Raw Scores on the 1937 
Revised Stanford-Binet Vocabulary Test 











~ Score MA Score MA* 
baer 5—4 23 16-4 
6 6-3 24 16-10 
7 7-2 25 : 17-4 
3 8-0 26 17-10 
9 8-10 27 18—4 
10 9-7 28 18-11 
11 10-2 29 19-5 
12 10-9 30 19-11 
13 11-3 31 20-5 
14 11-9 32 20-11 
15 12-3 33 21-5 
16 12-9 34 21-11 
17 13-3 35 22-5 
18 13-9 36 23-0 
19 14-3 37 23-6 
20 14-9 38 24-0 
21 15-3 39 24-6 
22 15-10 40 25-0 


* Values in this column are interpolated to a single 
point: score 38 (highest made in the standardization 
group; N=2) taken as equivalent to MA=24-0 (IQ= 
160). This interpolation corresponds perfectly to an ex- 
trapolation upward of the curve from scores 12 to 22. 


Reliability 


Though the mental age equivalents are 
given in years and months to conform to cur- 
rent practice, the reliability of the test does 
not warrant this degree of fineness. No di- 
rect data on reliability are available, but 
rough estimates may be made. Terman and 
Merrill give the median L—M correlation for 
the ages above 6 as .93 [3, p. 47]. They give 
the average correlation between vocabulary and 
the L—-M composite as .81 [3, p. 302]. If we 
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raise the .93 by the Spearman-Brown formula, 
we obtain .964 as the estimated reliability of 
the L-M composite. Dividing .81 by the 
square root of .964 gives .825 as an estimate 
of the correlation between vocabulary and 
“true” mental age. The lower limit of the re- 
liability of the vocabulary test is the square of 
.825 or .68. Its reliability could be this low 
only if it measured exactly the same mental 
function as the L—M_ composite, which is 
clearly not the case. We shall take .75 more or 
less arbitrarily as an estimate of its reliability 
in a single age group. 

The standard error of measurment is the 
standard deviation of the scores times the 
square root of one minus the reliability. Thus 





V1—.75 = .5, so the standard error of mea- 
surement is approximately half the standard 
deviation of the scores. McNemar’s Table 44 
[2, p. 141] gives the standard deviation of the 
vocabulary scores for each age group from 7 to 
18. Multiplying half of each of these values 
by the difference between adjacent mental ages 
in Table 2, at the point corresponding to the en- 
try in Column 6 of Table 1 for the given age 
group, we obtain the standard errors of mea- 
surement in months of mental age. Converting 
these values to fractions of a year and divid- 
ing by the age of each group, or by the equiva- 
lent chronological age for age groups 14 and 
over, we obtain the standard error of mea- 
surement of the vocabulary IQ for each age 
group. The values obtained range from 8.67 
to 11.90, with an average of 9.72. We con- 
clude, therefore, that the standard error of 
measurement of the vocabulary IQ is roughly 
ten points. This means that in interpreting 


such IQ’s we can place some confidence in the 
first figure, or the first two figures if the 
1Q is 100 or over, but none in the last figure. 
The 95 per cent confidence limits for a given 
vocabulary I1Q are approximately 
minus 20 points. 


plus or 


Summary 

Table 2 gives mental age equivalents of 
scores on the vocabulary test of the 1937 Re- 
vised Stanford-Binet Tests of Intelligence. 
Any inaccuracies in the table, whether due to 
the method of its derivation or to the limi- 
tations of the original standardization data, are 
small in comparison to the unreliability of the 
test. 

Despite its limited reliability, which is inevi- 
table in a 45-item test covering the whole 
range from age 6 to superior adult, this vocab- 
ulary test is useful as a short verbal scale. 

Vocabulary 1Q’s may be computed from 
these mental ages by dividing them by CA up 
to age 13, and thereafter by the CA equivalents 
used with the 1937 Revised Stanford-Binet 
Tests of Intelligence. For the interpretation of 
any such IQ, its last digit has no significance; 
the standard error of measurement is about 10 
points. 


Received January 12, 1954. 
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Arnold, Magda B., & Gasson, John A. Yhe human 
person. New York: Ronald, 1954. Pp. x + 593. 


$5.75. 


Ten Catholic psychologists met in a workshop “to 
formulate an integrated theory of personality based 
on a Christian conception of human nature.” This 
volume reports the planned individual papers and 
extra chapters on the discussion provoked by them. 
The material is organized into five parts: theory 
building, personality structure, personality integra- 
tion, psychotherapy and self integration, and self in- 
tegration through religion. The chapter devoted to 
Frankl’s existential analysis is an addition to the 
American literature on psychotherapy. Logotherapy 
or emphasis on the client’s ideals, aspirations, and 
deliberate choices deserves detailed systematic treat- 
ment. Too often therapeutic theory and practice have 
neglected a strong emphasis on the client’s life as an 
expression of unique goals with appropriate unique 
means to accomplish them. The editors present this 
book as a primary text in personality. It is rather a 
book on personality theory fairly wide in scope but 
with relatively little of the empirical findings woven 
into it. The two chapters on orthodox Christianity 
and 40 pages devoted to “a research method valid- 
ating self determination” make it a specialized book 
rather than a general personality text. This book 
can serve a wide audience mainly as a point of de- 
parture for much needed critical and unfettered dis- 
cussion of psychology and human values. It raises 
questions about the relationship between normative 
and empirical approaches to the human person 
which all psychologists might well consider. The re- 
viewer wishes it could have been possible for the 
writers to include a non-Catholic psychologist in 
their team to increase the objectivity of the presenta- 
tion and to integrate their views even more with 
contemporary psychology. — F. McK. 





Note. — The reviews were prepared by the Editor 
and the Associate Editors, who may be identified by 
their initials. 
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Burington, Richard Stevens, & May, Donald Curtis, 
Jr. Handbook of probability and statistics with 
tables. Sandusky, O.: Handbook Publishers, 1953. 
Pp. ix + 332. $4.50. 


This handbook is prepared in the style of the 
handbooks which are so important to such fields as 
chemistry and engineering; the binding, format, and 
materials are most attractive. The text is well sup- 
plied with formulas and terse discussions of their 
meaning and application. The tables are quite com- 
prehensive and include binomial distribution func- 
tions, Poisson distribution functions, Beta function 
ratios, distributions for the familiar statistics, trig- 
onometric functions, natural and common loga- 
rithms, and many other functions. The style and 
discussions are distinctly technical and the mathe- 
matical level of the presentation probably exceeds 
the preparation of most psychologists. — J. R. W. 


Fink, Harold Kenneth. Mind and performance. New 
York: Vantage Press, 1954. Pp. xi + 113. $3.00. 
This is the report of an experimental study of 

learning ability in a number of animal forms. An 

Arrow Maze, consisting of four parallel pathways 

leading off from a neutral area, was employed for 

all forms. Four successive goals were used for each 

of the species, and the criterion for learning was 10 

successful trials. Time limits were different for each 

species. Human subjects were blindfolded and the 
maze presented as a stylus maze. Results were 
treated to yield percentages of the learning ability 
of man, set at 100. The final rank order of the spe- 
cies tested was man, pig, dog, rat and chick, cat, 
turtles (4 species tested), with learning ability of 
the pig about half that of man. Pavlov’s concept of 
experimental extinction is employed to explain be- 
havior in learning successive goals. The author dis- 
cusses the relationship of his results to Crile’s sug- 
gestion that behavioral differences may be related 
to metabolic functions. — A. R. 


Freud, Sigmund. The origins of psychoanalysis: let- 
ters to Wilhelm Fliess, drafts and notes: 1887- 
1902. New York. Basic Books, 1954. Pp. xi + 
486. $6.75. 

Freud’s letters to Fliess covering the period from 

1887 to 1902 constitute not only one of the most im- 
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portant publications in the field of psychology ‘n 
years, but also a fascinating human document. 
Never intended for publication, the letters throw a 
light on Freud the person, the doctor, the scientist, 
and the philosopher. At one and the same time they 
show him as a human being and a genius, a boast- 
ing egotist and a disillusioned neurotic, a humani- 
tarian, a devoted family man, and a tyrant with 
his colleagues. But most of all, they reveal the pain- 
ful steps by which Freud developed his psychology 
—his keen observations, his tentative hypotheses, 
his probing, revising, accepting, and rejecting of 
concepts and theories until he was satisfied, and 
then frequently starting all over again because a 
new patient provided contradictions not previously 
met. Through the letters we follow him in his 
ups and downs, his satisfactions and disappoint- 
ments, his self-analysis. 


On October 16, 1895 he wrote, “I am practically 
sure I have solved the riddle of hysteria and obses- 
sional neurosis”; on January 1, 1897, “You can see 
that I am in the full swing of discovery”; on May 
31, 1897 he reports his first inkling of the Oedipus: 
“It seems as though in sons this death-wish is di- 
rected against their father and in daughters against 
their mother.” And so it goes, discovery after dis- 
covery told in personal revelations: “I have jotted 
them down for your eyes alone.” His first contact 
with infantile fantasy in neuroses, the development 
of libido, the mechanism of regression, the interpre- 
tation of dreams, the discovery of everyday psycho- 
pathology, of transference, and of many other psy- 
chological mechanisms are seen in Freud’s first ex- 
citement at their unfolding. Included in the volume 
is Freud’s “Project for a Scientific Psychology” 
which he wrote in 1895 and sent to Fliess for his 
opinion. This was an attempt to integrate neurology, 
psychology, and “objective” quantification into a 
“natural This project was later dropped 
by Freud, and many of its segments adapted in his 
numerous works. It is nevertheless historically im- 
portant. A welcome by-product in this publication 
is Kris’s masterful introduction, which throws much 
light on the letters. Kris’s footnotes throughout re- 
late the contents of the letters to Freud’s better 
known works. — M.K. 


Gill, Merton, Newman, Richard, Redlich, Fred- 
rick C., & Sommers, Margaret. The initial inter- 
view in psychiatric practice. New York: Interna- 
tional Universities Press, 1954. Pp. 423. $6.00. Rec- 
ords, 3, 12-in., 33 r.p.m., $4.60. 


science.” 


The first interview with a patient or client em- 
berking on psychotherapy has puzzled experienced 
and novice therapists alike, and little has been writ- 
ten about it. This volume and its accompanying 
records present a viewpoint about the initial inter- 
view, and provide excellent materials for discussion 
and instruction. The authors are critical of the tra- 
ditional psychiatric examination with its rigid 
structure and probing questions. They also do not 
entirely accept the position taken by nondirective 
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therapists and some psychoanalysts that the open- 
ing interview involves no evaluation or diagnosis. 
Instead they attempt with considerable success to 
blend a diagnostic attitude — appraising the pa- 
tient’s need, motivation, and capacity for therapy — 
with a recognition that the first contact is an integ- 
ral and often crucial part of the therapeutic process 
itself. The book consists of 119 pages of exposition 
and theory with a good review of the literature on 
the initial interview, and of 278 pages of verbatim 
illustrative material. Three initial interviews are 
given in full, witk the transcripts on the left-hand 
pages and a parallel discussion on the right-hand 
pages. Two of the interviews, by experienced and 
able therapists, illustrate the application of the au- 
thors’ approach. These interviews are not perfect, 
as the authors readily admit, but they are vivid and 
instructive. The remaining interview, conducted by 
an inexperienced student, shows most of the mis- 
takes that can be made in interviewing —the in- 
terviewer’s self-involvement, his inability to really 
hear the patient, and his defensive dependence on 
routine questions. The technically excellent phono- 
graph records, available at cost to qualified pro- 
fessional persons and institutions, give the listener 
many cues that are lacking in the printed transcripts. 
The authors’ moderate and eclectic conception of the 
initial interview will appeal to most readers as 
sound and widely applicable. The book and records 
supply unique and useful tools of instruction for 
clinical psychology and social work as well as for 
psychiatry. — L. F. S. 





Humphreys, Anthony, & Traxler, Arthur E. Guid- 
ance services. Chicago: Science Research Associ- 
ates, 1954. Pp. xvii + 438. 


This is a text for an introductory course in guid- 
ance services. It covers the five subject matter areas 
reflected in many present courses with appropriately 
greater emphasis on basic understandings, tools and 
techniques, and on students’ problems than on ad- 
ministration. The authors properly devote a chapter 
to the future of guidance services, and indicate the 
trend toward greater professionalization and in- 
crease in scientific emphasis. The swell of the trend 
seems to be definitely in the future if it includes re- 
duction of the nomothetic “do and don’t” presenta- 
tion and an increase in a style which stimulates 
deeper understanding of the individual student. 
Humphreys and Traxler should be commended for 
devoting a quarter of their book to “solving students 
major problems.” The discussion does not, however, 
devote much space to students’ cases. Student per- 
sonnel and guidance services are both defined on 
the same page, but it is not entirely clear to the 
reader how these overlapping terms differ basically. 
This whole field of endeavor, as the authors inti- 
mate, is undergoing a rapid transition and the pio- 
neer guidance workers in the field who have done 
much to improve the lot of individual students need 
to be better linked with the newly and more tech- 
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nically trained worker of the present. Books of this 
kind can do much to bring the two together. There 
is still, however, a great gap between the better 
books in guidance like this and the new volumes on 
counseling and personnel techniques. — F. McK. 


Peck, Harris, B., & Bellsmith, Virginia. Treatment 
of the delinquent adolescent. New York: Family 
Service Association, 1954, Pp. 147 (paper). $2.00. 
The authors have given us a realistic picture of 

the difficulties and successes in the use of psycho- 

therapeutic techniques with delinquent adolescents. 

There is an excellent appraisal of the limitations 

and potentialities of group therapy, both with par- 

ents and with adolescents themselves. Educators, 
family and social agencies, and all those working 
with delinquents will find this book challenging 

reading. — B.M.L. 


Warters, Jane. Techniques of counseling. New York: 
McGraw-Hill, 1954. Pp. viii + 384. $4.75. 


This is a broad survey of the techniques available 
for student personnel work. It is written simply and 
well, and in a manner that will be helpful to the 
teacher or school counselor in training. The tech- 
niques fall largely under the headings of tests, ob- 
servations, self-reports, status within the group, case 
study and conference, interview, and group meth- 
ods. There is no attempt to survey the literature 
broadly, but the selection is quite appropriate. The 
reader is given samples of common techniques and 
an acquaintznce with the uses, advantages, and dis- 
advantages wf each method. Moreover, a clear pre- 
sentation of practical issues, especially those with 
ethical aspects, is included. There is some discus- 
sion of counseling, but the integration of several 
techniques into actual counseling situations is left 
for advanced clinical training. Miss Warters faces 
the dilemma of most writers in the field: how to en- 
courage school personnel to use more objective tech- 
niques and at the same time instill sufficient caution 
concerning the limitations in the use of the tech- 
niques without supervised laboratory or clinical 
training. This problem is handled rather well. The 
reviewer, however, would have favored stronger 
and repeated emphasis on the necessity for more than 
verbal acquaintance with the techniques. — F. McK. 


Wolberg, Lewis R. The technique of psychotherapy. 
New York: Grune & Stratton, 1954. Pp. xiv + 
869. $14.75. 


Good psychotherapy, says Dr. Wolberg in his pre- 
face, “must depend on a basically sound therapeutic 
structure, irrespective of the specified ‘kind’ of 
psychotherapy done and without reference to the 
individual ‘style’ of the therapist. The purpose of 
this book is to delineate such a structure.” How well 
the book is judged to achieve this ambitious aim 
will depend on the experience and therapeutic pre- 
dilections of those who read it. Few will deny, how- 
ever, that this encyclopedic volume represents some 


of the most practical and down-to-earth writing 
about psychotherapy yet to appear in the literature. 
Rich in excerpts from recorded interviews and ori- 
ented around recurrent and realistic problems in 
therapeutic practice, it often has the flavor of a 
fruitful supervisory session. If its eclecticism and 
relative naiveté with respect to theory sometimes 
lead to contradictions and rather too easy solutions 
to difficult problems in the shadowland of thera- 
peutic knowledge, the book nevertheless presents a 
large distillation of practical wisdom won from 
long and intensive experience. It makes possible an 
intimate acquaintance with one thoughtful and well- 
grounded point of view toward therapeutic conduct. 
One regrettable shortcoming, constituting a chal- 
lenge to psychologists, is that in spite of its friend- 
liness to psychology among the professions offering 
needed psychotherapeutic services, and its recognition 
of some of the contributions to therapeutic thought 
made by psychologists, this big book makes very little 
reference to the insightful investigative work done 
by psychologists or, indeed, to research in the field 
at all. As a summary of one therapist’s considerable 
wisdom, The Technique of Psychotherapy is compre- 
hensive and admirable. For secure knowledge, we 
shall not surprisingly have to wait. — E. J. S. 


Wolstein, Benjamin. Transference: its meaning and 
function. New York: Grune & Stratton, 1954. Pp. 
xiii + 206. $5.00. 

Written with sensitivity, scholarship, and logical 
sophistication, this careful historical analysis of the 
concept of transference represents a genuine contri- 
bution to psychoanalytic theory. In the tradition as- 
sociated with Harry Stack Sullivan, the book 
develops the thesis that psychoanalysis is funda- 
mentally the study of interpersonal processes, that 
the therapeutic utility of transference phenomena 
lies in their enabling both therapist and patient to 
arrive at greater insights into the latter’s modes of 
relating to his fellows, and that the transference 
situation is not only a medium by which already es- 
tablished values may be re-examined but the seed- 
bed of new values and new orientations toward hu- 
man relationships. In the course of this development, 
Dr. Wolstein demonstrates that he has ideas, writes 
with style and a gentle persuasiveness, and com- 
petently levies on a quiet but impressive learning. 
It is a disappointment, however, to find a psycholo- 
gist writing so authoritatively in this field with a 
total disregard for the bulk of pioneering research 
that has been the central contribution of his discip- 
line to therapeutic knowledge. An integration of 
empirical findings with Dr. Wolstein’s informed 
level of theorizing could be a vast boon to psycho- 
therapeutic thought and practice. — E. J. S. 


Woodworth, Robert S., & Schlosberg, Harold. Ex- 
perimental psychology. (Rev. Ed.) New York: 
Holt, 1954. Pp. xi + 948. $8.95. 

The classic Experimental Psychology, first pub- 
lished in 1938, has been given a thorough revision. 

Most chapters are rewritten, some are new, and all 
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are brought up to date. Over half of the 2,480 en- 
tries in the bibliography were not cited in the earlier 
edition. In addition to its values for general psy- 
chology, what kind of a foundation does this book 
provide for students who will specialize in clinical 
psychology? An appraisal from this limited view- 
point is generally favorable. The three chapters on 
emotion have been revised extensively, with level of 
activation as an organizing concept. Learning is 
treated so as to provide a good base for the applica- 
tions of learning theory to personality development 
and psychotherapy. There is a new chapter on mo- 
tivation. Dynamic aspects of perception and memory 
have been given increased recognition. Of more im- 
portance than these details, however, is the general 
atmosphere of the volume. Its consistently functional 
and objective attitude, its persuasive demonstrations 
of the values of experimental method, and its clear 
and interesting style of writing will lead students 
not-only to learn experimental psychology but alse 
to appreciate and enjoy it. — L. F. S. 


Wulfeck, Joseph W., & Bennett, Edward M. The 
language of dynamic psychology as related to 
motivation research. New York: McGraw-Hill, 
1954. Pp. 111. $4.00. 


This volume is a glossary of terms commonly ap- 
pearing in the field of motivation and apt to be 
meaningless or confusing to the lay reader. Each of 
the terms presented is accompanied by a definition 
furnished by Wulfeck and by some explanatory 
comment by Bennett. The volume is sponsored by 
the Advertising Research Foundation and is de- 
signed to “help the advertising man to keep his 
terminology and his understanding abreast of cur- 
rent activities in the field of motivation research.” 
To the best of this reviewer's empathic judgment 
the book would seem to serve its purpose. The pro- 
fessional psychologist, however, will find little here 
to enlighten him. In fact, he may occasionally be 
jarred by expressions such as this, “Instinct (Psy- 
chiat) : a wastebasket category for the origin of any 
behavior which is not learned.” — W. A. H. 


Books Received 


Barrell, Joseph. A philosophical study of the human 
mind. New York: Philosophical Library, 1954. Pp. 
xii + 575. $6.00. 

Beck, Samuel J. The six schizophrenias. Res. Mon- 
ogr. No. 6. New York: American Orthopsychiat- 
ric Association, 1954. Pp. xiii + 238. $5.00. 

Bischof, L. J. Intelligence. Doubleday Papers in 
Psychology, No. 5. Garden City, N. Y.: Double- 
day, 1954. Pp. vi + 33 (paper). 85¢. 

Braatoy, Trygve. Fundamentals of psychoanalytic 
technique. New York: Wiley, 1954. Pp. xi + 
404. $6.00. 

Campbell, Paul, & Howard, Peter. Remaking men. 
New York: Arrowhead Books, 1954. Pp. 126. 
$1.50. 

Cronbach, Lee J. Educational psychology. New York: 
Harcourt, Brace, 1954. Pp. xxvii + 628. $7.50. 


English, O. Spurgeon, & Finch, Stuart M. Introduc- 
tion to psychiatry. New York: Norton, 1954. Pp. 
viii + 621. $7.00. 

Frank, Lawrence K., Harrison, Ross, Hellersberg, 
Elizabeth, Machover, Karen, & Steiner, Meta. 
Personality development in adolescent girls. Mon- 
ogr. Soc. Res. Child Develpm., 1951, 16, No. 53. 
New Orleans, La.: Child Development Publica- 
tions, 1953. Pp. 316 (paper). 

Frosch, John. (Ed.) Annual survey of psychoanaly- 
sis. Vol. II, 1951. New York: International Uni- 
versities Press, 1954. Pp. xiv +- 724. $10.00. 

Fuller, John L. Nature and nurture. Doubleday 
Papers in Psychology, No. 4. Garden City, N. Y.: 
Doubleday, 1954. Pp. vii + 40 ‘paper). 85¢. 

Haber, Heinz. The physical environment of the 
flyer. Maxwell AFB, Ala.: Air University, 1954. 
Pp. vi + 179. 

Himes, Joseph S. Social planning in America. 
Doubleday Short Studies in Sociology. Garden 
City, N. Y.: Doubleday, 1954. Pp. ix + 59 
(paper). 95¢. 

Hodgson, Kenneth W. The deaf and their problems. 
New York: Philosophical Library, 1954. Pp. xx + 
364. $6.00. 

Ittelson, William H., & Cantril, Hadley. Percep- 
tion. Doubleday Papers in Psychology, No. 7. Gar- 
den City, N. Y.: Doubleday, 1954. Pp. ix + 33 
(paper). 85¢. 

Joseph, Harry, & Zern, Gordon. The emotional 
problems of children. New York: Crown Pub- 
lishers, 1954. Pp. ix + 310. $3.75. 

Katz, Daniel, Cartwright, Dorwin, Eldersveld, 
Samuel, & Lee, Alfred M. (Eds.) Public opinion 
and propaganda. New York: Dryden Press, 1954. 
Pp. xx + 797. $6.25. 

Lazarsfeld, Paul F. (Ed.) Mathematical thinking 
in the social sciences. Glencoe, Ill.: Free Press, 
1954. Pp. 444. $10.00. 

Leonard, Edith M., Van Deman, Dorothy D., & 
Miles, Lillian E. Counseling with parents. New 
York: Macmillan, 1954. Pp. vii + 330. $3.75. 

Odlum, Doris M. Psychology, the murse and the 
patient. (2nd Ed.) New York: Philosophical Li- 
brary, 1954. Pp. 168. $4.75. 

Pearson, Gerald H. J. Psychoanalysis and the edu- 
cation of the child. New York: Norton, 1954. Pp. 
x + 357. $5.00. 

Piaget, Jean. The construction of reality in the child. 
New York: Basic Books, 1954. Pp. xiii + 386 
$6.00. 

Pickford, R. W. The analysis of an obsessional. 
New York: Norton: 1954. Pp. xii + 234. $4.00. 

Sar.son, Seymour B. The clinical interaction. New 
York: Harper, 1954. Pp. x + 425. $5.00. 

Savage, Leonard J. The foundations of statistics. 
New York: Wiley, 1954. Pp. xv + 294. $6.00. 

Schanck, Richard L. The permanent revolution :n 
science. New York: Philosophical Library, 1954. 
Pp. xvi + 112. $3.00. 
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Senn, Milton J. E. (Ed.) Problems of infancy and New York: Norton, 1954. Pp. xxiii +- 264. $4.50. 
childhood, 1953. New York: Josiah Macy Jr. Taylor, W. S. Dynamic and abnormal psychology. 
Foundation, 1954. Pp, 196. $2.75. New York: A.werican Book Co., 1954. Pp. xiv + 

Solomon, Joseph C. A synthesis of human behavior: 658. 

New York: Grune & Stratton, 1954. Pp. xii + Watson, Robert I. Psychology as a_ profession. 
265. $5.50. Doubleday Papers in Psychology, No. 8. Garden 
Sullivan, Harry Stack. The psychiatric interview. City, N. Y.: Doubleday, 1954. Pp. x + 65. 85¢. 
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